PREFACE 



The Kavy Personnel Research and Development Canter has established 
an Independent Research and Development Program. This program include? 
the function of planning and coordinating "state-of-the-art" symposia 
in areas critical to the Center's mission. The purposes of such sym- . 
posia are: (1) to assess the potential of""areas of sclence-and^_l:ech- 
nology for solving relevant problems, (2) to provide a basis for~ 
advancing science and technology and for planning future R&D, (3) to 
engage in meaningful technological forecasting, and '(4) to enhance 
inter and intra disciplinary dialogues among members of the Research 
and Development Community. 

Occupational Research was chosen as the first area for a sym- 
posium because of its central significance, its prospects as a 
prototype symposium and its suitability with respect to the purposes 
cited above. 

In planning the symposium, problems ^ivided quite naturally 
into logistics and content. A contract with Jakus Associates solved 
the logistics problem. Through this contract arrangements were made 
for carrying out the symposium and for providing for most of the 
typing, editing, proofing and formatting necessary in publishing the 
symposium proceedings. 

The leadership and cooperation of Dr. Ernest J. McCormick, 
Purdue University; Dr. Edwin A. Fleishman, American Institutes for 
Research; Dr. Marvin D. Dunnette» University of Minnesota; Dr. Robert 
Penn, San Diego State University; and Dr. Bernard Rimland, Navy 
Personnel Research and Development Center were obtained to help in 
the planning and organization of the symposium, in arranging for 
excellent sets of presentations by extremely well qualified people 
in five fundamental areas or topics of Occupational Research, and 
to serve as chairmen of the topic sessions. 

Each of the five topic sessions contributed to the symposium 
goals. 

Dr. McCormick* s sessiou on Occupational Analysis, Structure and 
Methods is a convincing display of the progress occurring since 
Shartle's milestone book in 1946. The wide application of occupa- 
tional analysis is best portrayed by the remarkable expanse and 
continuity of Air Force work under Dr. Raymond Christal with tKe 
marked power of computer support through the use of CODAP. The 
fine-grained development and applicatibn of Functional Job Analysis 
by Dr. Sidney Fine explicates Issues of language use, roles of 
organizations and individuals, and levels of analysis. The concept 
of tiiodules developed and described by Drs. Stephenson, Cory and 
Johnson, provides a mechanism for r>rgani2ing areas of task commonal- 
ity which allows real diversity in the use of modules as building 
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an Independent Research and Development Program. This program includef> 
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in areas critical to the Center's mission. The purposes of such sym- . 
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nplogy for solving relevant problems, (2) to provide a basis for 
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engage in meaningful technological forecasting, and (4) to enhance 
inter and intra disciplinary dialogues among members of the Research 
and Development Community. 

Occupational Research was chosen as the first area for a sym- 
posium because of its central significance, its prospects as a 
prototype symposium and its suitability with respect to the purposes 
cited above* 

In planning the symposium, problems ^Ivided quite naturally 
into logistics and content. A contract with Jakus Associates solved 
the logistics problem. Through this contract arrangements were made 
for carrying out the symposium and for providing for most of the 
typing, editing, proofing and formatting necessary in publishing the 
symposium proceedings. 

The leadership and cooperation of Dr. Ernest J. McCormick, 
Purdue University; Dr. Edwin A. Fleishman, American Institutes for 
Research; Dr. Marvin D. Dunnette, University of Minnesota; Dr. Robert 
Penn, San Diego State University; and Dr. Bernard Rimland, Navy 
Personnel Research and Development Center were obtained to help in 
the planning and organization of the S3rmposlum, in arranging for 
excellent sets of presentations by extremely well qualified people 
in five fundamental areas or topics of Occupational Research, and 
to serve as chairmen of the topic sessions. 

Each of the five topic sessions contributed to the symposium 
goals. 

Dr. McCormlck*s sesslou on Occupational Analysis, Structure and 
Methods is a convincing display of the progress occurring since 
Shartle's milestone book in 1946. The wide application of occupa- 
tional analysis is best portrayed by the remarkable expanse and 
continuity of Air Force work under Dr. Raymond Christal with tKe 
marked power of computer support through the use of CODAP. The 
fine-grained development and appllcatibn of Functional Job Analysis 
by Dr. Sidney Fine explicates Issues of language use, roles of 
organizations and individuals, and levels of analysis. The concept 
of (iiodules developed and described by Drs. Stephenson, Cory and 
Johnson, provides a mechanism for organizing areas of task commonal- 
ity which allows real diversity in the use of modules as building 
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blocks. The Position Analysis Questionnaire (PAQ) developed by 
Dr, McCormick not only contributes a standardized, well defined 
approach tu job/position description, but through the use of 
factor analysis defines dimensions and structure of positions in 
a unique, useful and stable manner. The utility to the military 
service of this area is well summarized in Dr, Christal's paper 
In which very pertinent recommendations for Navy use are pinpointed. 

Dr, Fleishman's session on Career Developifeat provides a rich 
and mixed bill of fare. The Walsh and Korman papers present and 
evaluate ^basic theoretical concepts. The Tiedeman paper provides 
an amazing exercise in jCQncie4>t.ual analysis. The England and 
Glickman papers tap earthy, empirical, reaFworld matters where 
Olickroan, in particular, deals directly with Navy problems in a 
Navy context. The problems of career Development are fully treated 
through discussion of Holland's theory and the concept of congruence, 
analysis and description of systematic decision making in career 
development, modeling career growth and decline, discussion of 
managers' value systems and career motivation. Each of these topics 
^ has implications for ITslefur resMrcTi~a^ 

with respect to career pl^^nning, development and evaluation. 

Dr, Dunnette's session on Organizational Effectiveness continues 
the emphasis on quality. This area exemplifies markedly the consis- 
tently recognized difficulties of the social sciences with respect to 
experimental design and control, applicable models, and development of 
principles. The challenge is great. Beginning with the Campbell 
paper » the issues are clear and the difficulties explicated. Thorough 
reading of the Campbell paper will ^how that it is an excellent review 
and provides a valuable backdrop against which to view the other 
papers in this fi^ id. Its range across the sociological origins of 
this area through the turning poin^ provided by the 1957 GeorgopoulouF 
and Tannenbaum study, thence into the "golden" period of the 60 's 
points a picture of effort dedicated toward empiricism and quantifica- 
tion, but characterized by an undercurrent of despair. The salient 
forecast concerning the endangered species, the contrast with organi- 
zational development, and the penetrating analysis of and concern 
with criterion problems typify Campbell's paper. Indeed, these 
features make the Campbell paper a classic which serves to enhance 
the already fine papers prepared by Milkovich, Franklin, Payne and 
Arima. 

Dr. Penn's session on Motivation and Work adds outstandingly 
another salient area of Occupational Research. Almost any reference 
in the long history of motivation as a central concept in beRkvioral 
science makes clear two things: The extreme practical utility and 
value inherent in understanding and controlling motivation and the 
extreme difficulty involved in achieving this ideal goal. Penn's 
paper, like Campbell's in the preceeding session, is a landmark 
review and an excellent background for the Graham and Zedeck 
papers. Penn's paper centers around t^he nine questions first 
raised by Gardner Lindzey in 1958 and the description and assess- 



ment of mechanical process theories and substantiva content th ^ories. 
Graham follows with insightful concern about the validity of current 
theories of motivation and difficulties of and suggestions for con*- 
ducting i 'Search. Zedeck's sphere is normative vs. ipsative models 
of measurement and new approaches in applying regression ana],ysis 
to motivational research. Thus Zedeck's paper suitably concludes 
this session while furnishing a bridge to the next. 

The final symposium session. Measurement and Prediction was 
ably organized by Dr. Bernard Rimland. Tiie session begins with a 
most interesting and forward looking paper by RimlauJ. Well aware 
of the "steady-state" of average validity coefficients achieved ty 
classical prediction techniques, Rimland describes the possible 
potency of Biological Approaches. Moonan's pap er ^n Vistas of 
Analysis breaks new ground in ?.n-ar^a-o^f^-=iong^^andiug concern in 
applied statistics! and measurement — the problem of dealing with 
qualitative or categorical variables. Moonan's cievelopments, 
together with able support in developing computer programs for 
putting his methods to work, hold high promise for both Navy and 
general application'. AgaiA^ -tW-McBride- and Weiss paper new 
ground is broken in a relatively new field — Ability Testing by 
Computer. Computers are pervading the universe in ways which 
sometimes make difficult the assessment of gains ^and losses. 
However, testing by computer is here to stay, first in a concep- 
tual, next in a pragmat;ic way. Advantages, strategies, models, 
difficulties, and categories of adaptive testing are well artic- 
ulated in the McBride and Weiss paper providing a sure bet for 
technological forecasting and future research and application in 
personnel testing. As anchor man, Bentler attacks a problem of 
both technical and social significance. Tae political and civil 
necessities for non-cognitive testing are presented along with 
a most lucid account of ten major problems of historical, current 
and future concern. Bentler 's discussion of these problems is an 
excellent finale for the symposium because his guidelines in an 
important area are so well presented. Adventitiously, ^but not 
surprisingly, an impressive number of the speakers based their 
papers on work supported by the Office of Naval Research. Three, 
of the five session chairmen also hold contracts with ONR. Thus 
the symposium provides still another Indication of ONR's role in 
the field of Occupational Research. ^ 

Altogether more than 150 people attended one or more of the 
various sessions of the symposium. Their voluntary reactions in 
the form of letters, telephone calls and direct comment demon- 
strate that the symposium was a success. This success is directly 
creditable to the session chairmen and the subtopic speakers all 
listed in the section titled "Participants". To all of these 
people and their affiliations, to the Office of Naval Research, 
and to J^kus Associates the Navy Personnel Research and Develop- 
ment Center expresses gratitude. 



EARL I. JONES 
Director 
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THE UNITED STATES AIR FORCE 
OCCUPATIONAL RESEARCH PROJECT 



Raynond E. Christal 
INTRODUCTION 

The United States Air Force Occupational Research Project was 
established In 1958, soae 15 years a3o» and has been supported con- 
tinuously since that time. The project ul^jectlves call for the 
development of methodologies In^a number of areas^ Including the « 
following: ^ 

Job Analysis (Collection, analyses, and reporting of Inforoiatlon 

defining work performed by personnel) 
Job Evaluation (for grade, pay and skill levels) 
Job Structures (Including job et^lneerlng, wrk organization, 

and occupational classification) 
Job Requi regents (for aptitude, training experience, etc.) 
Career Development 
Personnel Utilization . 

Job Satisfaction (in particular, as it relates to retention) 

Obviously, I cannot discuss even th>e highlights of a 15-year 
program In the limited time we have today. I will restrict my comrcnts 
to some of the techniques the Air Force has developed for collectings 
analyzing* and reporting occupational data and a lew recently completed, 
or ongoing studies which may be of interest to you. I will draw freely 
from previously published papers, my own memory, and data from studies 
yet to bo published. 

DEVELOPMENT^, OF JOB SURVEY TECHNIQUES^ 

t. 

Reasons for selecting the Job Inv entory Approach 

In the Air Force we chose the job Inventory as the only feasible 
approach for collecting work*task Information from large numbers of 
workers. There were a number of reasons for this decision: First , 
the technique Is economical. Data can be collected from thousands of 
people throughout the Service for less than It would cost to collect 
data on a few people using professional job analysts. Second, the 
information obtained using job Inventories is quantifiable. That is, 
the number of people performing any particular task can actually be 
counted and their characteristics described. Note that data collected 
by traditional job analysis are not quantifiable. No two analysts will 
describe a job in exactly the same terms. Third , the fact that in- 
formation collected with job inventories is quantifiable means it can 
he stored, manipulated » analyzed, and reported by computer. Finally , 
the fact that Inforuaatlon is quantifiable also means it can be validated 
and checked for stability using conventional statistical techniques. 
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A Job Inventory contains two sections: (1) Questions to be 
answered by^a worker ahour his Job and hiiBself - questions relating 
to naae, identification nimber, previous education^ tiBe->on<-the«*Job9 
tools used. Job location, equipment worked on, trainlnf^ aaiools, pay 
grade. Job attitudes, and so on. Any Item can be included In the 
background Information section of an Inventory which may help answer 
questions posed by managers. of the personnel system. (2) A list of 
the significant tasks that may be performed by workers In the occu- 
pational area to be' surveyed. That Is, ^ikiTpiting performed by 
apprentices. Journey-men, flrst-llne supervisors, and superintendents 
in one or more occupations, such as supply specialist or engine 
mechanic. If the task list is properly constructed, every worker in 
the occupation should be able to define his Job adequately in t. cms 
of a subset of tasks in the Inventory. 

Construction of Job Inventories 

Ordinarily, an initial task list is coMtructed from available 
printed materials. In the Air Force program, this list is first 
reviewed by 5 to 10 senior supervisors in an interview situaticm who 
correct technical wording and add additional tasks which are known to 
be performed by workers in their occupational area. This asqianded 
task list is then sent by mall for a field review by supervisors at 
various locations throughout the Air Force. According to the com- 
plexity of the occupational area, these mail reviews may ba«obtained 
from as few as 25 to as many as 100 supervisors. At some time during 
the construction phase, the task list is also reviewed by technical 
school Instructors. The final task list is arrived at throu^ this 
iterative process. 

There is some variation in construction techniques used by the 
military services. For example, the Marine Corps does not use a mail 
review procedure, but makes extensive use of personal interviews at 
many locations. The Army makes use of technical school Instructors 
as inventory constructors. The Coast Guard, which also constructs and 
administers inventories, essentially follows the Air Force techniques. 

\.^Alr Force experiences have led to two conclusions. Firsts in- 
dividuals who are untrained in writing task stateronts do a poor Job 
of building Job inventories for their own occupational area. It is 
better tr ^keep the pencil in the hanls of a trained inventory constructor 
and let supervisors in the field of Interest serve only as technical 
advisors. Second > if inventories are constructed by technical school 
instructors, care must be taken to see that they are not biased through 
inclusion of only those tasks which have relevance for training. For 
example, a task concerned with sweeping the floor has little relevance 
for training, but may have a great deal of relevance for managers in- 
terested in job satisfaction. Job evaluation, or Job re-engineering. It 
is best to have inventories constructed by individuals who have a broad 
perspective of all future applications of occupational data. 



1-1.2 



ERLC 



How inauy taslc^ should be Included In an Inventory? This has been 
a major problem faced by every organization entering the job survey 
business. Most agencies begin with inventories which are tpo short. 
Ten years ago, the Air Force inventories were averaging 250 to 350 
tasks. Today, Jthey are averaging around 500 tasks or move. Yet the 
Air Force has relatively narrow occupational >career ladders - approxi- 
mately 230 of them. Inventories constructed by smaller military services 
tend to be much longer. In the Australian Air Force,* for example, job 
inventories sometimes contain more than 1,000 tasks. Such lengthy 
instruments may appear to be a problem, but they are not as difficult to 
manage as one might think. If task statements are organized under duty 
headings; and if the^worker has to mark only those tasks ^^hich he 
actually performs, then even a long inventory can be filled out in a 
reasonable period of time. ?urthermore, it has been a common finding 
that detailed task lists lead to firmer conclusions concerning such 
things as the establishment of training requirements and the evaluation 
of occupational categories. 

How many backgrouirf questions are normally included in an inventory? 
It is extremely Important to be able to define any subgroup of people 
which may be of interest to management. If a manager wants to know the 
tasks being performed by aircraft mechanics wqrking on a particular air- 
craft at particular locations who have taken certain training and who 
have been on the job less than one year, this can be obtained only if 
background variables have been included which define the relevant char- 
acteristics. For reasons to be discussed later, the single most Important 
background variable for inclusion in a job inventory is worker identifica- 
tion. 

Hw many workers should be sampled in an occupational area? The more 
the better. If one were interested only in the occupation as a whole, 
then perhaps a small sample wuld suffice. But experience has shown that 
managers are often interested in definable groups such as females, indi- 
viduals at a particular grade or salary level, workers maintaining a 
particular type of equipment, -and so on. Unless one has collected informa- 
tion from a large sample, there will be insufficient numbers of cases to 
make reliable inferences about such groups of interest. Large samples are 
also needed to perforip meaningful job-typing analyses—especially if the 
occupational area is coo^lex. 

The £omprehensive Occupational Data Analysis Programs package (CODAP) 
is designed to handle data on samples of 2tt,000 workers, exdept for programs 
associated with job-typing analyses, which will now accept data on 7, OOP 
workers. The Air Force has attempted to obtain 100% samples in occupational 
areas containing 2,000 or fewer workers. In larger occupational areas, 
have attempted to obtain data on not fewer than 2,000 workers. If the 
occupational area is known to contain a variety of job types, we may obtain 
data on 5,000 or more workers. 
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What about the costs of da ta collection and analysis? The cost of 
developing an Inventory and of analyzing the results Is essentially the 
same, regardless of the length of the Inventory or the nuidier of persons 
to who© It Is given. It can cost between one and two houra of work time 
for each worker included In the survey, which Is of consequence. How- 
ever, In the Air Force, Inventories are administered so as not to 
Interfere with accomplishment of primary mission, so the costs and value 
are weighed against the costs and value of other nondlrect mission pro- 
grams which consume time, such as conmander's calls, formations, physical 
training, and so on. 

One cost which can be substantial is that of getting the response 
information onto magnetic tape, ready for cc»iputer input. All military 
services are, or soon will be, collecting data on optical scanning sheets. 
To the extent that data are processed by scanner, the cost of preparing 
data for computer input is reasonable. 

Mo specific answer about costs has been given but coats are sodest 
compared with the savings which can be generated from appropriate appli- 
cations of occupational data. This topic is directly addressed later. 

Administration of Job Inventories 

The problem of inventory administration . In the Air Force, inven- 
tories are sent in bulk to Consolidated Base Personnel Offices throu^- 
out the world. Instructions specify that yorkers meeting certain speci- 
fications will be called into testing 'rooms to fill out inventory forms 
under controlled conditions. In the Marine Corpa, the task analysis 
unit sends out teams to administer inventories on site at various loca- 
tions. They report excellent result^. However, tnis approach Is 
feasible only if a Service or organization has a limited nuidber of bases 
or installations. 

Instructions for filling out an Inventory are relatively simple. 
The worker completes the background section^ reads the task list %xA 
checks those tasks which he performs as part of his normal Job, writes 
In any significant tasks which he performs which vera tK>t in the task 
list, and then rates the tasks he has checked using a relative tlae- 
spent scale. 

The write-in feature serves several useful purposes^ but primarily 
it provides an indication of the quality of the task list. If a large 
number of significant new tasks are uncovered by th^ vrite«"in feature, 
the administration of a supplementary survey may be required. Otherwise^ 
the uncovered tasks are us^ to guide interpretation of reaulta and are 
saved for inclusion in the next form of the survey Instrument. 

Quality of Job Inventory Data 

Can workers be trusted to be thorough and completely honest when 
they fill out Job inventories ? Studies have been conducted concerning 
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this question. The answer Is definitely "Yes,'* at? least as far as ^ 
workers In the Air Force are concerned. When a worker fills out an 
Inventory on two occasions, he gives essentially the same Infonaa-- 
tlon both times. Split-half reliabilities for Information such as the 
percent of workers performing various tasks run from .95 to .99. 
Supervisors agree with the Information provided by their subordinates. 
Information collected with dally^ work records Is consistent with In- 
formation collected with inventories. Workers do ngt inflate their 
Job descriptions in terms cf the nuiid>er and difficulty levels of tasks 
they report. The work tadks reported by individuals are consistent 
with the Information they provide in the background section concerning 
tools utilized and equipment worked on. 

Hany such studies have been conducted and reported. However, the 
experiences which have convinced us beyond any doubt that we are getting 
high-quality information ar^ less objective and have never been fully 
documented. For example, during the first several years we obtained the 
telephone nuBd>er of every worker who filled out an inventory. When we 
received what we thought might be false information, we called the 
worker and talked with him about his Job. Over and over again, we found 
the worker was trying to be honest. Most often, the worker had been 
assigned a peculiar Job because'of local circumstances. In some instances 
our inventory contained bad task statements which did not allow the 
worker to reflect his true Job. We did find that, while being honest, 
many workers will give themselves the benefit of the doubt. For example/ 
a worker might claim to perform a task when, in fact, he only performs 
par^ of that task. This Is one of the problems with task statements which 
are too broad, and it helps to explain why our inventories now have over 
500 task statements. 

Another factor which helps us to feel confident about our data is 
that we have published analysis results from over 200,000 cases in 
approximately 150 occupational areas, and these results have never been 
proved wrong by managers, workers* or trainers in those occupational 
areas. There have been occasions when we were worried. In one instance, 
we found that very few worker^ were performing a large set of tasks which 
constituted approximately 25% of a training course. The managers of the 
occupational area were so unbelieving that they did an Independent survey 
interviewing every worker in the occupational area to see if, in fact, he 
performed any of the tasks in question. The results of this interview- 
survey were, for all practical purposes, identical with those obtained 
from the inventory administtation. Such experiences have convinced the 
researchers, and also Air Force management that Job inventories yield 
good data. 

Our latest experience with the power of job Inventories to give 
quality data came when we surveyed approximately 5,000 civilian workers 
in one occupational area. We were particularly worried in this instance, 
since civilian pay is directly tied to Job content. Under this circum- 
stance, a worker might feel he has something to gain by being dishonest, 
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or something to lose by being honest. Analyses Indicate that» even 
under this condition^ workers are honest. 

We feel there are two factors operating which cause us to get 
honest reports from workers, and that these factors are Interacting. 
First > the worker Is asked to provide his name and social security 
number in the Inventory^ and second > the information provided Is 
objectively verifiable. It Is unlikely that a worker will claim to 
perform a task when everyone around him knows that he does not perform 
that task. Similarly^ It Is unlikely that he will fail to report a 
task which everyone around him knows he performs. 

Importance of Worker identification 

There are several reasons why it is strongly recommended that name 
and identification information be obtained from workers who fill out 
job inventories. First > many studies daonstrate that hlgh--quallty 
data can be obtained when workers provide their names . If identlfica-* 
tion information is not obtained » one cannot even conduct a study to 
validate his data. Second > collecting identification information 
enables one to follow-up workers and trace their career development 
over time. Third s identification Information can be used to match with 
other personnel files to pick up additional data on workers^ such as 
their aptitude scores and work history. Finally , identification informa- 
tion enables one to produce a description of the work being performed by 
a particular person^ or to locate by name all individuals who are 
performing a particular task or set of tasks. 

Ose the "Relative Time S pent" Rating Scale 

Consider the rating scale for a few minutes » be cause this is an 
important topic. Research indicated that many workers do mst have a 
clear Idea of the exact percentage of their time devote to each task 
performed. On the other hand» they can state with confidence that they 
spend more time on one task than on another. This led to the development 
of a "relative time-spent" scale» by which workers report the asKyunt of 
work time spent on each task relative to the amount of time spent on 
other tasks. We use a 7-polnt relative time-spent 8ca|e. If an indivi- 
dual does not perform a task» he leaves it blank. If hrdoea perform lt» 
he rates it from a level "1»" which meanfl^ that he spends an extremely 
small amount of time on it compared to the amount ^of time he spends on 
other tasks in his job» to a level "7," which me^ns that he spends an 
extremely large amount of time on it compared with the amount of time he 
spends on other tasks in his job. These relative time-spent ratings are 
converted into estimated percent time values . The first question often 
asked by individuals reviewing this procedure is **Why percent time? Why 
not use some other factor such as frequency of performance?" 

It is beyond the scope of this paper to discuss all of the factors 
favoring use of perccmt time-spent estimates » but several are sufficiently 
important to warrant your consideration. Firsts there are certain 
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statistical characteristics which make this approach extremely useful • 
It has a clearly defined range with a base valu' of "O," For the 
individual case, the values indicate the percentage of his work time 
spent on each task, and the sum of these values across all tasks in the 
inventory is 100%, In a like manner, the average values for any group 
of workers indicate the percentage of group time spent on each task, 
with the sum of these values also equalling 100%, Percent time values 
provide a convenient method for computing the overlap of two individual 
Jobs with each other, of an individual Job with a group Job description, 
or of one group Job description with another group Job description. 
Results from numerous studies have indicated that matrices reflecting 
overlapping time among individual Job descriptions, when analyzed by the 
CODAP grouping program, can yield a precise definition of the types of 
jobs existing in an occupational area. Finally, having the percentage 
of tiTC spent on tasks available makes it possible to compute the time 
spent by individuals or groups on particular types of work. For example, 
a manager may wish to know how much time is being spent by a group of 
mechanics on preventive maintenance. This can be very quickly computed 

• by the CODAP system. It should be noted that none of the above charac- ' 
teristics apply to a scale such as "frequency of performance." How could 
one possibly summarize the level of activity across a series of tasks in 
terms of frequency, when some of the tasks are performed frequently, while 

- other tasks within the subset are performed infrequently? Use of the 
relative time*-spent scale as the primary rating factor in occupational 
surveys is strongly recommended. The obtained values should be trans- 
formed into percent time-spent estimates. This is a requirement for the 
CODAP system, and makes possible many types of analyses which cannot be 
accomplished using frequency of performance data« 

THE CODAP ANALYSIS SYSTEM 

CODAP is the analysis system used not only by the Air Force, but 
aist) by other military services. There is simply no way in a brief 
amount of time to communicate the power of this system. We have been 
working on it continuously for over 13 years, and the program listings 
now run about 1,400 pages in length. It represents an investment of 
hundreds of thousands of dollars, and thousands of in-service man hours. 
Yet, it is without question the most important product of the Air Force 
On-upat ional Research Project. 

The concept behind CODAP is to provide ways for analyzing, organi- 
zing, and reporting occupational information to answer as many 
management questions as possible. CODAP currently contains approximattsly 
40 general purpose programs, and several new ones are under development. 
All of these programs are interactive and highly efficient. A few pro- 
grams which are used frequently (See the Appendix for a description of 
selected CODAP ptograms and example CODAP outputs) are mentioned here. 

Example CODAP Programs 

One program produces a consolidated description of the work performed 
by any specified group of individuals. Such a description can be produced 
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for workers at a particular base; pr for those who have beeni in their 
jobs less than one year; or those who claim their talents are not 
being utilized; or those who work on a particular type of equipment — 
indeed, for any group of workers which a.n be defined in terms of 
information in the background section of the job inventory. A conso- 
lidated job description indicates the percent of group members perfortft- 
ing each task, the average percent of work time spent on the task by 
those who perform it, and the percent of group time spent on each task. 
A CODAP program^ prints the task statements and associated computed values, 
arranged in terms of percent members performing, or in terms of group 
time-spent Values. A consolidated description of the work performed by 
individuals during their first year or two on the job is particularly 
useful in validating or designing the curricula for entry-level vocational 
training • 

Normally, when analyzing an. occupation a series of job descriptions 
for groups at various experience levels is produced. That is, consoli- 
dated descriptions are computed for individuals who have been in the 
occupation for less than one year; from one to two years; from two to four 
years; four to eight years; and so on. Then the (X)DAP system is used to 
gather this information into a table which indicates the percent of indi- 
viduals at each experience level that perform each task in the inventory. 
In this way, we find when tasks tend to be assigned, and when training 
should be given in order to be timely. 

Another CX)DAP program enables managers to study the differences in 
work being performed by any two specified groups of individuals. For 
example, one might wish to know the differences in work performed by 
individuals at one grade level and those at another grade level; or in 
the work perforn^d by individuals working on two types of equipment. The 
CODAP system analyzes the two defined groups and prints a report summari- 
zing the major differences in work performed. 

Perhaps the most powerful CODAP program is one which identifies and 
describes all the types of jobs which exist in an occupational area. 
Beginning with 2,000 individual job descriptions, this program will compute 
a 4,000,000-element input matrix reflecting the similarity of each job with 
every other job. Then it proceeds to group similar jobs into clusters and 
prints out a description of work performed by individuals in each cluster. 
The program is iterative and may evaluate well over a billion alternative 
solutions in arriving at the best definition of job types and clusters in 
a particular occupation. Still another CODAP program can be used to deter- 
mine the characteristics and locations of individuals working in each job 
type and cluster. The results of job typing analyses are extremely valuable 
in identifying changes needed in defining occupational categories in an 
organization or military service. 

Other CODAP programs can be used to compute job descriptions for 
individuals, or for each individual in a specified group, or to compute 
the amount of work time each worker spends on a given set of taaks* Using 
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factor ratings in conjunction with task data, CODAP can be used to compute 
the difficulty level or the grade requir^ent for each job. Programs are 
available within the CODAP which will produce two-way frequency distribu- 
tions between background variables; compute the difficulty level of each 
task; compute intercorrelations , among background variables; determine the 
reliability of task factor ratings; compute the average grade level or the 
average experip.nce level of workers performing each task; compute regression 
equations; print. task lists, or print a dictionary of background variables. 
The CODAP system is also a general occupational information retrieval s/stem. 
All reports, descriptions, and analysis results computed by CODAP are stored 
and identified. Any subset of descriptions or reports can be extracted, 
ordered, and printed. CODAP even numbers the pages in an extracted report 
and automatically prints a table of contents. In general, there is a CODAP 
program available to organize and analyze occupational data to answer any 
question asked by managers of a personnel system. If we find that there is 
another type of analysis which would provide information on a question posed 
by management, then we immediately write a new program which will perform 
the necessary computations. This is one reason why all military services in 
the United States either are, or will shortly be, using the CODAP system for 
their occupational analyses. 

Adoption of Job Survey Technology by Various Agencies 

The Air Force did research on various techniques from 1958 until 1967. 
During this period, we collected experimental data from over 100,000 cases 
and developed most of the programs in the CODAP system. Although cost 
^ savings data were not accumulated during this .time period, occupational 
data led to numerous changes in training programs and occupational structures. 
In late 1967 the Air Force established an operational unit with 15 persons 
who devoted full time to the construction, administration, and analysis of 
occupational survey data. Its mission called for the completion of 15 
surveys per ypar. In 1969, the staff of this organization was increased to 
28, and the mission increased to 24 surveys per year. Last year, the staff 
was increased again, to 42 persons, and the mission was moved up to 51 
surveys per year. Each of these increases in staff and mission was due to 
demonstrated pay~offs of occupation information, and to increased demands 
from managers for more timely data. So far, the operational unit has 
surveyed over 200,000 enlisted persons in over 150 occupations. At present, 
68 surveys are in various stages of completion, and plans have already been 
made tor expanding the capability of the unit to meet the increased demands 
for more occupational data» 

In the Air Force, the greatest pay-^off from occupational data so far 
has been in thn area of trainings Significant changes have been made in 
every training course associated with an occupational survey. Frequently 
these changes ^ve not led to cost savings, since they have been in the 
form of reducing training on certain tasks while increasing it on others. 
Even so, approximately $7,000,000.00 cost avoidance has been documented 
during the past two years alone^ directly attributable to reductions in 
training based on occupational survey information. 
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Encouraged by Air Force occupational survey research findings » the 
Marine Corps established an operational unit which Is currently manned 
by 37 persons p three of whom work full time In maintaining Job structures. 
So far they have surveyed 11 of their occupational areas , which contain, 
nearly one-third of their manpower. The Marine Corps had the Air Force 
CODAP system reprogrammed to operate on an IBM 360-65 computer* The Job- 
typing programs have produced results leading to major changes In the Job 
structures In every occupation surveyed thus far. During the past year, 
they have documented over^ $A»000»000.00 In cost avoidance based upon their 
occupational analysis results, a large savings considering the relatively 
small size of their personnel system. This year, the Marine Corps task 
analysis group received a Presidential Management Improvement Award. 

The Army has an operatio/ial Job-task analysis group consisting of 
35 full-time persons. They have been collecting occupational data twing 
Job inventories for a number of years. To date, they have been using 
their own analysis programs , but they are planning several significant 
changes in their procedures. These include the collection of worker 
identification data, use of the relative time-spent factor for a portion 
of their task list, and use of the CODAP to supplement their own analysis 
system. 

The Navy has recently conductf»d several large^rscale occupational 
surveys using job inventories and processed the data with CODAP. The 
Navy officially established an operational job-task group this month 
atid is pledged to use the CODAP syateii for analyses. 

The Coast Guard has been conducting occupational surveys for several 
years with job inventories patterned after t^ose uoed in the Air Force. 
All of their analyses thus far have been conducted using the CODAP system. 
They have now surveyed about one-third of their occupational areas. 

The Canadian Forces have surveyed most of their occupations using 
job inventories, although, to date, they have used their own computer 
analysis programs. The Australian Air Force has 70 inventories in some 
stage of development. While these instruments tend to include a large - 
number of task statements, they are c*'h£fwl8e patterned after those 
produced by the U. S. Air Force. An exchange officer frcna the Australian 
Air Force has recently completed a 2 1/2 year tour working in the Air 
Force occupational research program and studying the CODAP system. A 
second exchange officer has now moved into this position. 

Many Universities, government agencies, and government contractors 
have collected occupational data using Job inventories, and a number of 
these have accomplished their analyses using the CODAP system. To date, 
the CODAP system has not been available to industrial organizations, 
although it has been used by many non-profit organizations, especially 
those conducting research under government sponsorship. 
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All of these programs emphasize three points: First , there seems 
to be a large movement toward conducting occupational surveys using job 
Inventories; second , many agencies are using, or are planning to use» 
the CODAP system for data analyses; and third , occupational analysis 
programs are generally In good health and expanding* 

APPLICATIONS OF JOB SURVEY INFORMATION 

Occupational data car and:^hould have an Impact on almost every 
part of the personnel system, the only thing lacking Is the develop- 
ment of appropriate technology, and this Is a major mission of the Air 
Force Occupational Research Division.. Only a few of the applications 
being studied by this organization are mentioned. 

Task->Level Experience Records 

To my knowledge, no military service and few Industrial organlza-^ 
tlons maintain individual work experience records at the work-task level. 
In the Air Force, a man may be assigned for a two-year period as a jet 
engine mechanic at a particular base and spend nearly all of this time 
working in a shop balancing jet engine rotors. When he is transferred to 
a^new base, about all we know about him is that he spent two years at a 
particular base as a jet engine mechanic. We may assume that he gained 
experience on many maintenance tasks during this period \4ilch, in fact, he 
did not perform. We also have no record that he has received so much 
experience in balancing rotors. 

Since a job Inventory contains all the significant tasks being 
performed by personnel in an occupational area, it provides an ideal 
framework for establishing and maintaining individual experience records. 
Individuals can be trusted to provide an > accurate statement of tasks 
currently being performed by using a job inventory. It may be that they 
can also be trusted to report their past experiences in terms of tasks 
listed in the inventory. This is a topic for research. Potential 
applications for task-level experience records: To evaluate the capa- 
bilities of the personnel force, to guide on-the-job training programs, 
to locate individuals with particular skills, and to guide reasslgnments. 

Development of Task and Job Dltf Iculty Indexes 

One recent breakthrough by the occupational research group is the 
development of a technique for evaluating the relative difficulty levels 
of tasks and jobs in an occupational area (Mead, 1970a; 1970b; Mead & 
Chrlstal, 1970), Task difficulty is a complicated concept. A task can 
be difficult to perform because repair parts are hard to get; the technical 
manual is hard to understand; the environment is hot; and several other 
reasons. After considering many alternatives, a definition was selected 
which reflects the amount of time it takes for individuals to learn to 
perform a task adequately. Supervisors in an occupation cannot rate the 
time it takes for workers to learn to perform tasks; but they can agree 
that, other factors held constant, workers can learn to perform some tasks 
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faster or. slower than they learn to perform other tasks. Inter-rater 
reliability coefficients concerning the relative difficulty of tasks 
within an occupation, based upon 30 to 40 raters, generally range in 
the middle to upper 90's. 

An equation has also been developed which enables us to determine 
the relative difficulty levels of Jobs within an occupation. Firsts 
we used the CODAP system to randomly select and publish multiple copies 
of 250 individual Job descriptions in one career ladder. Then Super- 
visors in the field ranked these Jobs in terms of their relative 
difficulty levels. Again, we found high inter-rater agreement. Using 
the job rankings as a criterion vector, we applied the pollcy-capturlng 
model (Christal, 1968a; 1968b; Bottenberg & Chris^al, 1968) In an attempt 
.to develop an equation which would reproduce the policy decisions of the 
supervisors concerning Job difficulties, Twenty-tW) predictors were 
hypothesized; but only three predictors entered into the equation. The 
same approach was repeated in 11 other ladders, and in every instance, 
the same three predictors were able to reproduce the supervisory rankings. 
These results are shown in Table 1. 

Let's study this table for a minute. First notice the three 
predictors. Predictor 1 is the number of tasks in the Job, and Predictor 
2 is the number of tasks squared. Inclusion of the squared term is 
necessary because there is a curvilinear relationship between the number 
of tasks in Jobs and their perceived difficulty levels. Predictor 3 is 
a complex variable reflecting the average difficulty level of tasks per-- 
formed per unit time. This variable is computed by the CODAP Variable 
Generation Program (VARGEN) , and is simply the cross-products of time 
spent and task difficulty, summed across all tasks in the Inventory for 
a particular Job. 

Notice that when these three variables are properl> weighted, the 
resulting composite shows remarkable ability to predict the supervisory 
Job difficulty rankings. Also notice the standard score weights In all 
12 equations look very similar. As a matter o£ fact, they looked so 
similar that we began to wonder if it might not be possible to develop a 
universal Job difficulty equation. In order to run a first test of this 
hypothesi$, we averaged the standard score weights across the 12 ladders 
for each predictor; then we applied this single general equation back to 
the 12 samples to determine its^predictive efficiency. Table 2 presents 
the results from this exercise, Notice that in every instance^ the 
general equation is almost as efficient as the least squares equation 
developed within the sample. 

All of the career ladders shown in Tables 1 and 2 are relatively 
low level, aad there is some question as to whether the general equation 
will be applicable to more technical occupations. In one recent study 
the general equation yielded a valid coefficient of .89 for tbe informa- 
tion career ladder, which is moderately encouraglrg, and .80 for the 
Weather Observer career ladder, which is not so encouraging. If it turns 
out that the general equation holds up, wc will no longer have to go to 
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the trouble of establishing criterion vettors* We will ai^p^y h«vs 30 
to 40 supervisors In each area rate the task difficulties; then ve can 
apply the general equation to determine the difficulty levels of all Jobs 
surveyed « We already have programs In the OODAP system for performing 
the necessary computations. 

Discussion of a few of the applications made of task and Job diff i<- 
culty indexes: 

Technical School Versus O n ^The- Job Training 

In over 30 career ladders, the Air Force has established what it 
calls a Category B training plan. Under this plan, a proportion of the 
assigne^es to the ladder are sent directly to the field with no formal 
training, %rtiile the remaining individuals go through an entry-level 
resident training course, and then are sent to the field • One would 
think that, if there is any flexibility in work assigOMnt, those who 
have had the benefit of formal resident training would tend to Inherit 
the more conqilex and dilf icult Jobs, He have tested this hypothesis, 
using the job difficulty index as one criterion. The aimlysis is a 
model^seeking design, with two treatments and a concomitant varl^le. 
The two treatmentdi are Technical School Graduates (TSG) and Directed 
Duty Assignees (DDA) ; the concomitsnt variable is TiM in Military 
Service (TMS); the criterion is Job difficulty level; and aptitude Is 
held constant. Figure L shows some of the possible ^cls. 

Model A shows an unlikely situation where the difficulty of work 
does not change ovttc time, and where the regression lines for TSGs and 
DDAs are identical. Model B shows Job difficulty increasing ovtf time, 
but again, the regression lines for th^ ' groups are identical. 
Model C shows the difficulty level of Increasing over tlma^ and the 

regression lines to be parallel: but at all points in time, the TSGs 
are inheriting more complicated Jobs than the DDAs, Model D was con- 
siderer to be the most likely. It shows the difficulty level of work 
increasing for both groups over time. However, during the early tiro 
period, the TSGs are being assigned less difficult work than the DDAs, 
This makei sense, since the DDAs will have been on the Job while the 
TSGs were in the classroom. However, Model D shows tjiie TSGs catching up 
with and passing the DDAs in terms of the difficulty level of work inherited* 
The basic question is when does this cross-over occur. With a re-enlistment 
rate of 20 or 30 percent, it needs to occur well before the end of the 
first enlistment if the technical training course is to be worth its cost. 
The analysis program locates the appropriate model and reports a^.1 the 
parameter values. 

Detailed results from application of the model to eight career ladders 
arc reported by Lecznar (1972), In general. Model B was found to be die 
correct representation. That is, while the difficulty levels of Jobs in- 
creased over time,, at no point (between the 5th and 35th mon^h of service) 
was one group revealed to perform more difficult Jobs than the other. The 
3ame type analysis was run against five other criteria: (a) number of 

1-1.14 



15 

26 




/tc /. Comparison of technical school fraduates md directed duty 
asM^iicos fn terms of difraulty le^ of woik Udierited. 



tasks performed, (b) average difficulty level of tasks performed per 
unit time, (c) official airman performance ratings, (d) job Interest, 
and (e) felt u::llizatlon of training and talents. 

With few minor exceptions, no diffen^nces were found between TSGe 
and DDAs in any of these analyses. Figure 2 displays results for the 
ConsBunications Center Career Ladder (291X0). The regression lines are 
Identical tor TSGs and DDAs against all criteria except for the nuidier 
of tasks performed. Ther*» is a slight tendency ^or those trained on the 
job to perform mote tasks than those trained in the formal entry-level 
course. 

There haw been a concerted effort in fhe Air Force to make On-the- 
job Training (OJT) programs equivalent to resident training programs for 
the Category B areas. This study provides more evidence that equivalency 
is being attained. As an interesting side-lisht, a recent study has been 
completed comparing the relative costs of resident training versus OJT 
for the 291X0 Career Ladder (Dunham, 1972). The results of this study 
indicated t^e cost of technical school training to be $2,780, while the 

1-1.15 

16 

ii7 




6 

o 

U 
(0 

m 

IT 
H 



75 

70. 

65. 

60. 

55. 

5C- 

45- 

40- 



4.55/10 



291XX 




NTP 
Mn - 50.77 
SD - 29.34 



10 



15 20 25 
TAIMS 



30 35 40 



u 
o 

8*9.0 

S8.5 
c 



!8.0 



4) 7.5 

D4 



.224/10 



291XX 



ss.ojt.^^ 

r *.62.i 



iMn Al 
73.6 



a 

< 



e 



APR 
Mn - 8.19 
SD." •\.03, 



5 10 15 



20 25 30 35 40 
TAFMS 





5.5' 




5.0. 


u 




CO 
0) 


4.5^ 


u 

0) 




4J 




M 




Job 


3.5; 



-.292/10 291XX,^ 



JI 

Mn - 4.24 
SD - 1.60 




10 15 20 25 30 35 40 
TAFMS 



u 
H 



4.5 



a 

0) 

«4.0 

0 3*5 

c 
o 

133.0 

CO 
N 

1 2.5 fe. 



-.080/10 29m 



62.4 



UTT 
Mn » 3.29 
SD - 1.44 




J. 



5 10 15 20 25 30 35 40 
TAFMS 



Figure 2. Comparison of technical school graduates and directed 
duty assignee! on various criteria 



ERIC 



17 



2B 



1-1.16 



cost of OJT was estimated to be $1,311 (median cost estimate). The 
upper limit of OJT cost estimates (95% confidence) was reported to be 
$1,515, still considerably less than the reported cost oif resident 
training. Most of this difference Is attributable to the cost of 
equipment, maintenance, training aids, and administration, which are 
calculated to be considerably less for on-site training. 

Difficulty of Work Asslf^ned to Personnel as a Function of Their 
Aptitude Levels , — 

In 1967 the Department of Defense established a program titled 
••Project 100, OOO'* which required the military services to accept quotas 
of personnel who fell below previously operating mentil standards. The 
Air Force initiated a number of studies to determine how these indivi- 
duals succeeded during their first enlistment (four years). Data were 
easily obtained concerning elimination rates in basic training, technical 
schools, and during post-school service. Scores were also available on 
written proficiency tests and official performance rating forms. However, 
there was one matter which plagued the investigators: •'How do we know 
that these' individuals are not being assigned tasks to perform as a func- 
tion^ of their altitude levels?'* True, aptitude scores were not being 
provided to supervisory personnel. However, a supervisor might perceive 
some of his subordinates are more talented than othfers, and ml^t assign 
the brighter airmen to do the comp3.icated tasks, ^ile assigning tasks 
such as sweeping the floor to airmen perceived as being "dull," And if 
a "dullard" does an excellent j(* of sweeping the floor (his assigned task) 
and If he does it with a good attitude and enthusiasm, will the supervisor 
give him a bad performance rating? Answer: Probably not," Since the Air 
?arce can use only so many floor sweepers in a specialty, it was deemed 
important not to draw any conclusions abmit the success of •'New Mental 
Standards" (NMS) airmen until it was determined whether they had been given 
differential treatment as a function of their ability. 

Since the definition of New Mental Standards airnien changed several 
times during the course of Project 100,000, the question was generalized 
to evaluate the difficulty of work assigned personnel as a function of 
their aptitude levels (Wiley, 1972), Data were collected using Job inven- 
tories from approximately 14,000 airmen in 11 career ladders which had 
received large Inputs of low aptitude personnel. In fact, approximately 
47% of the cases (6,520) were Category IV personnel, while nearly 27% of 
the cases were classified as New Mental Standards airmen. 3 

The data were analyzed using the Multiple Linear Regression Model, 
In general, the approach was to determine the unique contribution of 
aptitude in accounting for the variance in (a) Job difficulty, (b) the n 
number of tasks performed, and (c) the Average Task Difficulty Per Unit 
Time .(ATDPUT) , Variables such as in-service training, time-in-service, 
time-in-Job, grade, job location, command assignment, etc., were held 
constant. Results of these analyses are summarized in Table 3, 
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TABLE 3. UNIQUE CONTRIBUTION OF APTITUDE (AFQT) IN PRBDICTIHG 

DIFFICULTY OF WORK ASSIGNED 



Unique Contribution of Aptitude to R 



AFSC 


N 


' ATDPUT 


# Tasks 


Job 
Difficulty 


291X0 


862 


.014" 


.001 


.006 


473X0/1 


720 


.011*^ 


.004 


.000 


SA3X0 


470 


.002 


.021C 


.019*^ 


551X0/1 


835 


.006 


.001 


.002 


571X0 


1,214 


.006*^ 


.001 


.002 


605X0/1 


813 


.001 


.000 


.004 


631X0 


875 


.Ollb 


.004 


.003 


645X0 


1,567 > 


.007C 


.001 


.002 


647X0 • 


1,469 


.011^ 


.ouP 


.013^ 


702X0 


2,452 


.019^ 


.005 


.011^ 


811X0 


2,644 


.022'> 


.000 


.004 



^Average Task Difficulty Per Unit Tine 
Sign, at .01 level 
"Sign, at .05 level 



Althougli several of the R s in Table 3 are significant at die .05 
or .01 levels » in no instance did the unique contribution of aptitude 
exceed .02. It was conclwled that there was no practical difference 
in the difficulty level of work being assigned to personnel in these 11 
ladders as a function of their aptitude levels. Various interpretations 
can be placed upon this finding. It could be that supervisors in these 
ladders have very little flexibility in the way that they can assi^ 
work to subordinates. Another » and possibly vore strai^t-forward in- 
terpretation, is that personnel assigned to these ladders have sufficient 
aptitude to per f ore all available tasks. In any event » It appears that 
the NMS airaten did not receive differential treatnent with respect to 
their work assignaents. 

One unexpected finding was that, in nearly all Air Force Specialties 
(AFSs), aptitude correlated higher with the ATDPUT variable than it did 
with the Job difficulty coopoaite. A tendency was observed in several 
ladders for supervisors to assign fewer, but more coaplex taska^ to the 
brighter personnel. The significance of this finding will be discussed 
later. 



Differences in Work Assi^^ to Blacks and Non-Blacka 

Since approximately 19Z of the cases in the NMS alraan study des- 
cribed above were Black, the data provided an ideal base for analyzing 
racial differences on variables such as the difficulty of work assigned. 
Job interest, and felt utilization (Christal, 1972) . Table 4 presents 
zero-order correlations between Race (Black -1; 0 otherwise) ud selected 
variables within each of the 11 career ladders in the NMS study. Althou^ 
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sone of the relationships reported in this table are significant, they 
are all very low. The more meaningful findings are reported in Table 5 
which displays the unique contribution of Race in the prediction of the* 
Job assignment-satisfaction criteria. The variables held constant in 
each equation are presented in Table. 6. 

Three of the ciiteria are associated with the nature of work being 
performed by incumbents in the various career ladders: (a) the nuAer 
of tasks being performed, (b) the average task difficulty per unit time, 
and (c) an index of job difficulty. As indicated in Table 6, the 
variables held constant related to age, training, aptitude, education, 
and experience. When these variables were held constant, it was found 
that there were no significant differences in the number of takks being 
assigned to Blacks and Non-Blacks in the samples under consideration. 
Furthermore, there were no significant differences in the average diffi- 
culty levels of tasks performed, weighted by the time spent on each task 
However, when these two criteria were weighted into an index of overall 
difficulty level, it was found that Blacks were being assigned signifi- 
cantly less difficult j<*s in two career ladders: 60510 Air Passenger/ 
Air Cargo and 702X0 Administrative. Although these differences were 
statistically significant at the .01 level, they were, nevertheless, 
small. In each instance, the race variable uniquely accounted for less 
than IZ of the criterion variance. 

Table 5 also reflects racial differences In expressed job interest 
and in reported utilization of talents and training. Significant racial 
differences appeared in only two career ladders^ In each instance, 
however, they were in the direction that suggested the Blacks found their 
jobs more interesting aai felt that their talents and training were being 
better utilized than did the Non-Blacks. These findings are unusual in 
two respects. First, In the case of the 291X0 Coimminications Center 
Ladder, the unique contribution of race in accounting for feelings of 
being well utilized had an F ratio of 27.48, which is highly significant. 
Even though the Blacks and Non-Blacks were being assign^ jobs and ••asks 
of coipparable difficulty levels in this ladder, the Blacks felt that they 
were being better utilized, in the case of the 702X0 Administrative 
Career Ladder, it was found that the Blacks were being assigned jobs which 
were slightly less difficult than jobs assigned the Non-Blacks. In spite 
of this, the Blacks expressed a hi^er feeling of utilization and job 
interest than did the Non-Blacks. In the remaining nine career lidders, 
there were no significant differences in expressed attitudes. 

Prediction of Civilian Grade Classification and Analysis of Biases in 
Classification Actions " "~' ~~ — ^ 

Until recently. Air Force experience in conducting occupational 
surveys with job inventories was restricted to enlisted Wnd officer 
samples. Analyses revealed survey data to be of good quality. In 1971 a 
first attoBpt was made to survey Civil Service personnel (Garza, 1972). 
Since civilian .graces are tied to job content, there was some fear that a 
civilian might feel he had something to gain by being dishonest, or 
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something to lose by being honest in describing his job. Portunttely, 
there was no indication of distortion in the data received from 5,485 
job incumbents surveyed in seven series of the Accounting and Finance 
occupational area. Several analyses; wore made of tHpsp data (Carppnti»r 
& Christal, 1972) which utilized task and job difficulty indexes. One 
Involved an attempt to predict the official grade classification of 
each position, and the second involved an analysis to detect biases iu 
grade classification actions. The reader should understand that grade 
classification actions are based upon job descriptions provided to the 
classifier by the supervisor, while the analyses reported below are 
based entirely upon data reported by job incumbents in job inventory 
forms • 

Table 7 indicates multiple Rs which were obtained from information 
concerning the amount of time spent by incumbents on particular tasks. 
In order to r^uce the problem of overfitting, the tasks were split into 
two problems, and those entering either equation were used as predictors 
in a third problem. Although this did not completely eliminate capita- 
lization on chance, it did reduce It to tolerable limits, considering 
the number of criterion observations available. 

The task variables which entered the composite model were then 
combined with certain background variables to predict authorized GS 
grade. These background variables included those relating to the diffi- 
culty l*!vel of the job (Number of tasks, ATDPUT, and Job Difficulty 
Index); job location; command; personal characteristics of the incumbent 
(such as sex, age, marital status, etc.); and a large number of incunfcent 
experiences and training variables. Readers who wish detailed information 
concerning the subsequent analyses can refer to the published report 
(Carpenter & Christal, 1972). A series of full and restricted regression 
models was computed to determine whether non-job-related variables had 
influenced grade classification actions. In general, it was found that 
factors such as the incumbent's age, sex, marital status, and factors such 
as command assignment and job location, did not systematically demonstrate 
a significant source of bias in grade determinations. One exception was 
the discovery that jobs in the Washington DC area are classified about 
one-half grade level higher than jobs located elsewhere, other factors 
held constant. 

Table 8 presents the zero validity coefficients of the Number of 
Tasks Performed, ATDPUT^ and the Job Difficulty Index (computed with the 
general equation) for the authorized GS grade levels of jobs in the seven 
series. Except in the 520 and 540 series^ the ATDPUT variable showed 
substantial validity for all series. One discouraging finding was that in 
three ladders, the job difficulty equation, as computed by the general 
equation, had less validity than one of the individual variables weighted 
into the equation. Although the general equation may universally predict 
supervisor's ratings of job difficulty, it would appear wise to retain 
the separate elements of the equation in attempting to predict other 
criteria. 
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Table 6. PmKclon Used to Account for Vaiiance in Selected Criterit 



Crlt«rloA 













rml\ 












UttlUatton 




Job 


NymMr 


Oifflciiity 




•f T»t«Alt 




CMfflcwIty 


•f Tatiii 


J«b 








UfUt TlMM 






Mo:uhs m J oh 


X 


X 


X 


X 


X 




X 


X 


X 


X 


X 


Ti>ti! Montlis Active Mililsrv SIcnncfi 


X 


X 


X 


X 


X 


Vv ..rS of FdL.(!3tiOfL 


X 


X 


X 


X 


X 


\. Ccnule 


A 




X 


X 


X 


aOF Mechanical Al 




A 


X 


X 


X 


aOL Aamini&trative Al 


y 


V 
A 


X 


X 


X 




V 

X 


X 


X 


X 


X 


AO I* l*'ccrronii'< Al 


V 

X 


X 


X 


X 


X 


Tt\htiiL'«il School Graduation ry£«/NA\ 


y 
A 


A 


X 


X 


X 


Ai'o '»f i'nltstfnpnt 


X 


X 


X 


X 


X 


Job Difficulty Index 








X 


X 


Number of TaJcs Performed 








X 


X 


Avcra};c Task Difficulty Per Unit Time 








X 


X 


Grade 








X 


X 


Number of Subordinates 








X 


X 


CONUS Assignment 








X 


X 



TABLE 7. CORRELATION OF TASK 
Groop A 







# VARs 


Mult. 


tiS Series 


N 


Entering 


R 




856 


68 


.741 




1,305 


55 


.564 




1,710 


66 


.720 




203 


39' 


.869 


540 


307 


49 


.724 


544 


604 


29 


.725 


545 


500 


41 


.772 



VARIABLES WITH AUTHORIZED GS OlADE 



Group B Composite 



# VARs 


Mult. 


# VARs 


Mult. 


Entering 


R 


Entering 


R 


73 


.755 


77 


.813 


49 


.582 


76 


.649 


69 


.691 


81 


.755 


36 


.896 


38 


.924 


49 


.752 


65 


.819 


32 


.759 


44 


.V93 


48 


.752 


57 


.805 



TABLE 8. VALIDITY OF CERTAIN MEASURES OF JOB DIFFICULTY FOR 
PREDICTING AUTHORIZED GS GRADE CLASSIFICATION 



Predictor 501 

ATDPUT*^ ,51 

No, of Tasks Performed .25 

Job Difficulty Index ,45 



GS Series 



520 


525 


530 


540 


544 


545 


.17 


.54 


.47 


.23 


.58 


.51 


.20 


.23 


.65 


.18 


.35 


.32 


.30 


.39 


.67 


.29 


.46 


.51 



^Average Task Difficulty Per Unit Tiice 
Task Factor Approach to Job Evaluation 
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Task Factor Approach to Job Evaluation 

Another potentially important use of occupational data is in the 
area of job evaluation — the process by which pay and grade requirements 
are associated with Jobs* Although there are a number of approaches to 
job evaluation, most large agencies use some type of poiat rating system. 
In such a system, each job is rated on a series of job evaluation factors, 
and the factor ratings are weighted into a job evaluation composite score. 
The job evaluation composite score is, in turn, converted into a grade or 
pay requirements level. The factors and factor weights employed in many 
job evaluation systems are in reality regressions equations developed to 
predict agreed-upon grade or pay levels for a set of benchmark jobs. 

Although development of a job evaluation system is relatively 
straight-forward, applying it is another roattet. How does one obtain 
unbiased factor ratings on tens or hundreds of thousands of jobs? We 
are working on a systefa using task-level data which may be of interest 
to you. Instead of obtaining factor ratings on jobs, we are obtaining 
them on tasks which have been included in job inventories. Since every 
job in an occupation can be described in terms of the tasks In an inven- 
tory, we can simply apply CODAP and compute the factor scores for each 
job. Also, CODAP can be applied to weight the factor ratings for each 
ioh into a job evaluation composite. This process assures that Job 
evaluation is conducted in a systematic and unbiased manner. 

In one recent test of this technology, an attempt was made to 
develop a system for evaluating thu skill-level requirements for jobs 
in two Air Force career ladders. Task-level job descriptions were 
published using the CODAP system for 400 positions In the Fuel Services 
ladder (631XX) and 677 positions in the Personnel career ladder (732XX) . 
These -descriptions were rated for appropriate skill-level requirements by 
senior supervisors in the field, yielding mean ratings with computed 
inter-rater reliability coefficients of .95 and .92, respectively. 

An independent group of supervisors in each ladder rated all tasks 
in a job inventory for their ladder on a series of job evaluation factors, 
•such ss knowledge requirements; responsibility for use and control of 
money, supplies, or equipment; required special training and work 
experience; oral and written conmunications; supervisory responsibility; 
decision-making requirements; task difficulty; etc. All such ratings were 
collected using an 8-point relative task comparison scale. The instruc- 
tions went something like this; "Compared with other tasks in your career 
ladder, when a man is performing this task^ what level of conmunications 
skill is he exercising?" If no coununication skills are required, the task 
is assigned a value of "0." If communication skills are involved in per- 
forming the task, rating of from 1 to 7 is assigned, according to the 
level of requirement compared with other tasks in the ladder. Reliability 
coefficients for the various factors (based on vector of mean ratings) 
ranged from ,93 to .99. 
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Scores were developed on each Job description for each factor using 
the CODAP system. For example, one variable reflected "the average level 
of communication skills exercised per unit time." For a particular case, 
this is simply a sum of the cross-^ppoducts of the time spent values and 
task indexes, across all tasks in the inventory. The factor information 
was then combined with other Job information, such as the number of sub- 
ordinates supervised, in an attempt to predict the supervisory skill- 
level criterion ratings. 

It was found that a major portion of the criterion variance could 
be accounted for by only four variables plus two squared terms > as 
follows: 

1. Number of tasks performed 

2. Number of tasks performed, squared 

3. Number of subordinates 

4. Number of subordinates, squared 

5. ATDPUT (Average Task Difficulty Per Unit Time) 

6. ADMPUT (Average Decision-Making Requirement Per Unit Time) 

TABLE 9. PREDICTION OF SKILL LEVEL REC TREMENTS TOR 
JOBS IN TWO AIR FORCE CAREEF LADDERS* 

N R R 

Careel: Ladder Jobs Full Model 6-Predictor Model 

Fuel Services 400 ,96 .95 

Personnel 677 ,94 [92 



0 

See Text for definition of predictors. 

Table 9 reports the Multiple Correlation Coefficients for, the full 
model (33 predictors) and for the^ six variables previously shcnm* It 
should be noted that application of the 8ix-<^ariable equations require 
obtaining task ratings from supervisors on only two factors: Task 
Difficulty and Decision-Making Requirement. The number of tasks performed 
by each worker is automatically computed by CODAP, and the number of 
subordinates is normally obtained by a background question Included in Job 
inventories. The two squared terms in the equation were required In order 
to account for anticipated curvilinear relationships. The number of tasks 
in Jobs normally increases from the apprentice level through the first- 
line supervisory level; then falls off somewhat at the superintendent 
level. This is because a first-line supervisor both supervises and 
performs *:asks, whilst a superintendent normally does not perform 
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journeyman-level tasks. In a like manner, the number of immediate 
subordinates reaches a peak at the first-line supervisor level. Note 
all three variables which enter ..nto the Job Difficulty Equation entered 
Into the skill-level equation for the two ladders. 

Use of Task Difficulty Indexes In Determining Training Requirements 

In the Air Force we have saved millions of dollars by eliminating 
training on tasks which occupational survey data have revealed to be 
performed by few workers. However, data concerning the probability of 
school graduates doing certain tasks in their first or second assignment 
is insufficient to make sound decisions concerning school curricula 
(Christal, 1970) . We are attempting to collect additional information on 
each task in an inventory in order to determine how much emphasis should 
be given to it in the entry-level course. These factors give consideration 
to such things as the consequences of inadequate performance; the prob- 
ability that the task can be performed adequately without specialized 
training; the estimated cost of teaching the task in a formal training 
course as compared with teaching it on the job; the probability that the 
task may have to be performed in an efnergeiicy condition, where there is no 
time to obtain information on how it should be done; the perishability of 
the skill; and so on. The method for combining such information into 
curriculum decisions is not simple. For example, ordinarily a task will 
not be included in a course if the probability of a worker having to perform 
it is very low. On the other hand, if the task might have to be accomplished 
in an emergency, such as performing mouth-to-mouth resuscitation, or fighting 
a certain type of chemical fire, or evaluating a radiation count— and if the 
consequences of inadequate performance are serious, and if the probability 
of being able to perform the task adequately without formal training is low — 
then it certainly should be included in the entry-level course. Our goal is 
to develop procedures for evaluating each task on factors such as those 
described above, and to develop equations which can be applied to each task 
to determine how much emphasis should be given to it in the training course. 

Data on factors such as those previously mentioned have been collected 
on tasks in the Medical Services Career Ladder. Analyses revealed that 
correlation between Task Difficulty Indexes and the rater "probability of 
adequate performance without specialized training" was .96. Thus, once 
again. Task Difficulty Indexes, where difficulty is defined In terms of 
relative time to learn, will assist in solving an operational problem* 

Two points concerning the application of occupational data to training 
First , one simply cannot provide massive computer printouts of occu- 
pational information and expect trainers to use them. It is necessary to 
explain how the data can be used and also to convince trainers that the 
data are trustworthy. ^In some instances, trainers may be reluctant to 
eliminate training or tasks, even though there is overpowering evidence 
that such a move would be cost effective. In the Air Force, directives have 
been issued which require trainers to review survey data and "show cause" 
as to why tasks performed by few workers should be included in the entry^ 
level course* Second , a course curriculum cannot Ue designed solely from 
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job survey data. Once the teaks to be trained have been Identified^ 
trainers must go Into the field to observe the nufld>er and sequence of 
steps required In the performance of each task to be Included.^ In the 
course. 

Determination of Relative Aptitude Regulrenenta Ualna a Benchmark 



Aptitude requirement levels for entry Into various Air Force career 
ladders were Initially established by judgment. Adjustments have been 
made from time to time, based on recomnendatloiis from field commanders 
and trainers. When an aptitude requirement has been raised, It has 
generally been because someone has gone to a great deal of trouble 
documenting the fact that the jobs in an occupational field have become 
more complex and demanding. ^ Requirements for new career ladders have been 
set by comparing them with similar existing career ladders. The subtests 
entering Into aptitude composites have routinely^ been validated against 
training .course grades; but only in a few Instances have attempts been 
made to correlate subtests or composites with actual performance on the 
job. This has been due mainly to the non-existence of acceptable job 
performance measures. ^ 

Many times during the past 25 years, Hq USAF has validated aptitude 
requirements for all career ladders. In each instance^ soft answers were 
provided. At present, It is not possible to defend any level of aptitude 
as being an absolute minimum for success In a career ladder. If training 
is carefully designed and increased, Individuals with lower aptitude might 
succeed who otherwise would not. Job performance' aids and automatic 
checkout equipment can reduce requirements for high aptitude personnel in 
some ladders. Given sufficient time on the job, low aptitude personnel can 
learn to perform many tasks which they could not learn in a short period of 
time. There are many such factors that have trade-*off valuea with aptitude. 
Even if factors such as training, experience, and performance aide are held 
constant, there is still no completely satisfactory way to. eatabliah 
aptitude minimuma in the absence of objective work performance atandards and 
a method of evaluating personnel against such standards. 

Yet, the matter of setting realistic aptitude requirements can be 
extremely important. For example, lowering a requirement from the 80th to 
the 60th centile could double the number of individuals eligible to volun- 
teer for service in a particular career ladder. As we have moved into a 
zero-draft environment, there has already been some degradation of high 
aptj-tude talent in the applicant pool. A point may be reached where it is 
no longer possible to fill quotas at stated requirement levels. What then? 

One solution would be to generate more applicants through offerings of 
increased pay and benefits. However, predictions of lower budgets and ex- 
penditures on national defense do not make this approach look promising. It 
may become necessary to find some way of operating the force with less talent. 
This being the case, now is the time to begin building contingency plans for 
actions which could be taken if trouble is encountered. 
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During the course of some of the studies described earlier in this 
paper, several members of the occupational research team developed a 
strong feeling that task and job difficulty, defined in tenns of time to 
learn, reflects aptitude requirements. Some support for this hypothesis 
can be found from the results of training research. If training time is 
held constant, aptitude relates to the amount of material mastered; but 
if everyone is trained to a standard and allowed to move at his own pace, 
aptitude relates to training time. Another clue came frou. a study in 
which we computed a correlation of .92 between supervisory ratings of 
task difficulty and the proportions of an independent group of supervisors 
agreeing that tasks could be performed adequately by low ability workers. 

Following these clues, a series of systematic studies were initiated 
to determine the relationship between relative aptitude requirements for 
work tasks as judged by behavioral scientists, and relative difficulty 
levels for the same tasks as judged by supervisors (Fugill, 1972; 1973) 
In the first study, a correlation of .89 was obtained for a set of mech^i- 
cal tasks. In a follow-on study, a correlation of .93 was obtained for a 
set of electronic tasks. Finally, a correlation of .89 was obtained for a 
set of adminiscrative tasks. Thus, a close correspondence between diffi- 
culty defined in terms of "time to learn" and aptitude requirements was 
established. 

These findings suggest that one can use relative difficulty ratings 
from supervisors to compare" the relative aptitude requirements for tasks 
and jobs within career ladders. This information alone can be of some 
benefit for building contingency plans. For example, most career ladders 
contain several types of jobs which may vary in difficulty. The CODAP 
analysis system can be used tq identify these job types, and difficulty 
indexes can be used to determine which job types might be shredded out 
into new management units for performance by lower aptitude personnel. 
The task difficulty indexes can also be used to identify tasks which 
might be pulled out of existing jobs and engineered into new jobs for 
performance by less talented individuals. However, in order to build the 
most meaningful contingency plans, what is needed is a method for com- 
paring aptitude requirement levels for jobs across all career ladders. 
This would help the Air Force determine where stated requirements can be 
reduced with the least danger to mission accomplishment, and without 
changes in the classification structures. The approach taken to solve 
this problem was the development and application of benchmark scales. 

This approach can be outlined in general terms. 

Steji 1. Select a set of career ladders requiring the same type of 
aptitudes, for which job inventories and recent occupational survey data 
are available. 

Ste£ 2. Collect ratings from supervisors to determine the relative 
difficulty levels of all tasks within each ladder. 
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Step 2* Select 30 to 40 tasks at .various difficulty levels fro« 
each ladder. This will form the benchmark set. Reliability of final 
results will be enhanced If the tasks selected for the benchfliark set are 
well knom or easily observed. 

Step 4, Obtain relative aptitude requlreaient ratings for tasks In 
the benchmark set from knowledgeable behavioral sclent lifts. 

Step 5. Within each ladder, compute least squares regression 
equations to predict task aptitude requlreaelats trcm task difficulty 
levels. 

Step 6. Apply the equations developed in Step 5 to re-scale all 
tasks in all ladders into a common aptitude requirements framework (the 
benchmark scale). 
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Figure 3. Relative Aptitude Requirement Within Benchmark Set 
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Figure 3 presents 20 points representing 20 tasks on a particular 
career ladder which were included in the benchmark set. The position 
of a task on the vertical axis represents its difficulty level relative ' 
to all other tasks in its own career ladder. Its position on the 
horizontal axis represents its aptitude requireaent level relative to 
other tasks in the benchmrk set of tasks. A i oe oi best fit has been 
drawn through the points. Using this graph, the relative difficulty 
index values can be converted into aptitude requireaent levels for all 
tasks in the career ladder. If this procedure is repeated for all 
ladders having tasks .represented in the benchmark set, the final product 
Is a set of values indicating the relative aptitude requirement levels 
for all tasks tn all ladders. The same results can be obtained, without 
actually plotting points and reading graphs, by simply developing and 
applying leas^-squares regression formulae. 

Ste£2« Using the task aptitude requirecent data, the CODAF system 
is applied to occupational survey data to determine the relative aptitude 
requirement levels for all jobs in all ladders. 

Step 8.i The requiranent levels for ..st term jobs are compared 
ecross liddei^s. 

Ste£ 9. .The requircaents levels are determined for each type .of Job 
identified in each career ladder hy the CODAP system. 

Step 10. The amount of work time being spent on low requiraaent ta^^ks 
is determined for each job in every career ladder. 

A test application of this technology was made by the Air Force Human 
.resources Laboratory's Occupational Research Division. Part of this ctudy 
was accomplished in-house, and partly by contract with the Systems Deve- 
lopment Corporation. Generally, the study was conducted as follows: 

In the first stage, an in-house study was coflq)leted which involved 
10 ladders in the Administrative and General aptitude areas. Two hundred 
seven tasks were selected for inclusion in the benchmark scale, ^ich 
represented the range of difficulty in each ladder. As a second considera- 
tion, the tasks selected were those which in-service personnel were most 
likely to understand without observation in the field. Twelve in-service 
behavior scientists rated tasks in the benchmark set on relative aptitude 
requirements, and 40 to 100 supervisors in the field rated all tasks 
within their respective career ladders on a relative difficulty scale. 
Correlations between task difficulty levels and aptitude requirement 
levels were generally in the upper 80' s for the benchmark tasks representing 
various ladders. cession equations were computed and applied to re-ticale 
all tasks in all ladders in terms of their relative aptitude requirement 
levels. 

Realizing the dangers of having in-service personnel rate tasks with- 
out first-hand knowledge, a contract was negotiated with Systems Development 
Corporation to repeat the study on 10 career ladders, six of which were 
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identical to those in the in-house study. The contractor study involved 
280 benchmark tasks. Six behavioral scientists spent six weeks at several 
bases observing these 280 tasks being performed and interviewing workers 
and supervisors before executing their independent ratings of relative 
aptitude requirements. 

For the six common career ladders, the corrtractor and in-house studies 
produced essentially equivalent results. Therefore, the two studies were 
• . merged, yielding relative aptitude requirement levels for all tasks in 14 
career ladders. These aptitude requirement indexes were applied to occupa- 
tional survey data in the 14 career ladders, and relative aptitude require- 
menn levels were computed for every position in each of these ladders. For 
reasons which are too complicated and numerous to discuss in this presenta- 
tion, the individual position requirements were based upon the "average 
requirement level of tasks perfonn^d per unit time." The CODAP system was 
then used to compute the mean, distributions, and standard deviations for 
first- termer jobs in each ladder, as well as for each job- type in eaph 
ladder. 

The primary results of the completed stuc^ are shown in Figure 4, 
The data in Figure 4 gives consideration to the difficulty level of every 
task in thousands of individual first- termer jobs. For each ladder, the 
horizontal line reflects the relative aptitude requirement levels for first- 
term jobs falling minus one and plus one Standard Deviation around the Mean. 
That is, the bars show the aptitude requirement levels for approximately the 
middle 68Z of jobs in each ladder. The left hand column in this Figure 
indicates the current aptitude requirement levels for the 14 ladders. The 
vertical lines, representing estimated AQE equivalents, have been drawn 
arbitrarily, and are designed to assist in evaluating the relative aptitude 
requirements. 

If the Air Force cannot fill quotas at the 80th centile level, it would 
appear that requirements could be lowered to 70 in both the Information and 
Weather career ladders. Under more severe pressures, the Accounting and 
Disbursement requirements could be dropped from 80 to 70. The actual aptitude 
requirements for all four of these ladders appear to be less than they are for 
the Procurement ladder; yet the current stated requirement for the Procurement 
ladder is only at the 70th centile level. 

At the 60 level, the Air Force should be able to drop the requirement 
for the Communications Center ladder to 50 and the Medical Material ladder all 
the way down to 40. In the face of drastic shortages, consideration could be 
given to dropping the requirement for the Administrative Ladder to 30. Even 
if we do not run into problems in filling quotas, the data in this figure 
could be used to make certain adjustments which would bring ladders into propel 
alignment. 

Most career ladders in the Air Force contain more than one type of job. 
For example in the Disbursement Accounting ladder, some individuals spend 
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full time computing travel vouchers, some keeping manual military pay 
records; some operating military pay computers; some paying and 
collecting cash; and so on. The CODAP system includes programs for 
identifying and defining the job types in each ladder. Cue type of 
contingency plan which could be implemented in an emergency is to shred 
out certain Job types within ladders which can be performed by indivi- 
/ duals with lower aptitudes. A few examples are shown in Figure 5, 6, 
and 7. 

So far, two types of contingency plans have been described. One 
involved identifying career ladders for which the aptitude requirements 
can be lowered with the least danger to mission accomplishment. The 
second involved identifying job types within existing ladders which can 
be separated out and made into new specialties for performance by i«di- 
viduals with less talent. A third type of plan involves removing simple 
tasks from existing jobs and engineering them into new jobs for performance 
by individuals with less talent- The CODAP analysis system will compute 
the amount of work time being spent by every individual in a career ladder 
on such easy tasks • Other CODAP programs can provide summary tables in- 
dicating the amount of time spent on low-level tasks by all individuals at 
various locations. If one proposed to re-engineer jobs, this would tell 
him where he might have the best chance of success. 

Job Satisfaction Research 

There is a great deal of research evidence in the civilian sector 
indicating that factors related to job content and job conditions influence 
the decisions of individuals to stay with or leave work situations. In the 
Air Force, factors related to job content, assignment location, and worker- 
supervisor interactions are among those frequently cited by individuals for 
their decisions to leave the service. As we have moved into a zero-draft 
environment, retention of qualified workers has become an extremely iii^- . 
portant goal. Such individuals are available in limited quantities, and 
they are difficult to enlist, expensive to train, and hard to replace. In 
recognition of this, the Air Force has recently placed increased emphasis 
on job satisfaction research. A full-time effort in this area was initiated 
a little over a year ago. Fortunately, data on two factors ("Job Interest" 
and "Utilization of Talents and Training") had already been collected in job 
inventories for over 130,000 workers in approximately 150 occupational areas. 
Detailed analyses of data on these two factors are currently underway, but a 
few observations have already been made (Gould, 1972). Extensive differences 
in expressed job satisfaction have been found to exist between career ladders 
and among individuals within career ladders. For example, in some ladders 
fewer than 53 of the workers report that their talents and training are not 
being utilized in their present work assignment; while in other career 
ladders, over 50Z of the workers report their talents and training are being 
utilized "very little" or "not at all." We have conducted intensive studies 
in a few career ladders in which a large number of individuals report low 
interest and utilization, and found that in many instances there is ample 
justification for such feelings (Stacy, 1973). 
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So far, we have been able to account only for a modest portion of the 
variance In attitudes among Individuals within career ladders. Tables 10 
and 11 report the validities of certain predictors for the Interest and 
utilization factors. The full model Includes predictors such as Job 
difficulty, grade, tlme-on-Job, aptitude, education, connand, unit and 
base size, and age. All of these variables In combination yielded Rs which 
are only of modest size (.29 - .47). The largest and most consistent re- 
lationships are associated with the difficulty level of the work assigned 
and the aptitude level of the worker. These relationships are not large; 
but they are significant and always In the same direction. The most satis** 
fled workers tend to be those who have the lowest relative aptitude and who 
are assigned to the most difficult work. In these tables, the variable 
"Work Difficulty" represents a least-squares weighted combination of (a) 
the number of tasks performed, (b) the number of tasks performed (squared), 
(c) the Average Task Difficulty Per Unit Time, and (d) a complex variable 
which Is the sum of che cross-products of time spent on each task and the 
average grade level of all personnel In the career ladder currently per- 
forming that task. 

The long-term job satisfaction research program of the Occupational 
Research Division Involves three phases. First , recognition that job 
satisfaction is multi-dimensional. We are attempting to isolate and 
define all significant job-related factors which should be included in our 
job satisfaction studies. Second , determination of the ImpsTct of each 
factor on career decisions. Finally , determination of how jobs amd jab 
conditions can be modified so that workers will look favorably on the Air 
Force as a career choice. 

With respect to the first goal, we have developed a group of 330 
attitude statements which we feel cover the satisfaction domain. These 
are being analyzed using a combination of cluster analysis, factor 
analysis, and regression analysis, with the goal of producing a minimum 
set of attitude measures which cover all important dimensions. Phase II 
will involve determining the impact of each attitude on the reenlistment 
decisions of workers in each career ladder. This turns out to be a very 
complex problem. In the civilian sector, one can Jimply administer a job 
attitude questionnaire to a sample of workers and, at a later point in 
time, relate the score values to a criterion of "1 if still on the job; 
0 otherwise." In the military setting^ jobs are constantly being modified^ 
and individuals are frequently moved from one location to another. There 
is no easy way of continuously tracking each individual and measuring 
changes in job content, job conditions, and job attitudes over time. 
Furthermore, we don't know when each ir'^ividual finalizes his decision to 
reenlist or get out of service. 

We have developed a method, based on cross-sectional data, for 
inferring the probable impact of a particular job attitude on the re- 
enlistment decisions of personnel in a particular career Tadder. The 
model is made possible by the fact that all enlistments in the Air Force 
have been for a 48-month period. It involves construction of a regression 
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TABLE 10. PREDICTION OF REPORTED "UTILIZATION OF TALENTS AND TRAINING' 

BY FIRST-TERM AIRMEN 



Career 




p. 1 1^ 
Full 


Work 


No. Tasks 






Ladder 


N 


Model 


Ditticulty 


Performed 


ATDPUT 


Avg AI 






A A 


O 1 

• 21 


. ^1 




-. 


4/3 


720 


• 3d 


oo 
• 2o 


• 21 


1 o 


-.UJ 




*♦ / u 


An 


• 




• U / 


— . 


551 


836 


.45 


.32 


.28 


.30 


-.11 


605 


814 


.43 


.27 


.23 


.20 


-,16 


631 


876 


.36 


.19 


.07 


.15 


-.20 


645 


1,568 


.34 


.10 


.05 


.06 


-.18 


647 


1,470 


.34 


.14 


.11 


.12 


-.14 


702 


2,452 


.35 


.22 


.20 


.09 


-.18 


571 


1,214 


.29 


.14 


.07 


.13 


-.15 


811 


2,644 


.32 


.22 


.15 


.21 


-.10 



See text for definition 

Average Task Difficulty per Unit Time 



TABLE 11. PREDICTION OF REPORTED "JOB INTEREST" 
BY FIRST-TERM AIRMEN 



Career 




Full^ 


Work^ 


No. Tasks 






Ladder 


N 


Model 


Difficulty 


Performed 


ATDPUT^ 


Avg AI 


291 


862 


.38 


.18 


.16 


.00 


-.14 


473 


720 


.40 


.26 


.15 


.22 


-.03 


543 


470 


.34 


.16 


.15 


.07 


-.14 


551 


836 


.47 


.28 


.25 


.23 


-.02 


605 


814 


.41 


.28 


.21 


.22 


-.13 


631 


876 


.40 


.24 


.06 


.20 


-.16 


645 


1,568 


-30 


.11 


.10 


.04 


-.06 


647 


1,470 


.32 


.16 


.12 


.13 


-.03 


702 


2,452 


.32 


.18 


.15 


.09 


-.08 


571 


1,214 


.30 


.19 


.09 


.18 


-.02 


811 


2,644 


.38 


.29 


.19 


.27 


-.06 



.See text for definition 
Average Task Difficulty Per Uhit Time 
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curve which predicts the attitude of Individuals still on board at each 
month of military service. In order to afford some protection against 
the problems of interpreting cross-sectional data in a longitudinal , 
manner, aptitude is held constant, and the regression line is drawn for 
those at the mean aptitude level. 

To be more precise, assume that we are predicting the job Interesjt: 
level for a particular group. The predictors included in the equation 
would be as follows: 



^1 




Months of Service (continuous) 


^2 




1 If Xj^ = 0-48; 0 otherwise 






1 If Xj^ > 48; 0 otherwise 


\ 


ae 


Xj^ If Xj = 1; 0 otherwise (or Xj^X2) 


h 


m 


X 2 
*4 






Xj^ If Xj - 1; 0 otherwise (or Xj^X^) 


h 




X 2 


h 


at 


Average Aptitude Index on the AQE 



Note that the regression weights associated X^t X^, and X- will have 
an impact only with respect to individuals in their first enlistment. The 
weights associated with X^, X^ and X- will impact only upon individuals 
who have elected to reenlist in the Air Force, and who are now beyond the 
48th month of service. f 

The upper left curve in Figure 8 presents a regression curve for a 
subsample oi nearly 8,000 cases drawn at random from 130 Air Force career 
ladders. Interpreting this curve in a longitudinal manner, it appears 
that Air Force personnel have a slight decline in job Interest during 
their first enlistment. The jump in the curv/e between the 48th and 49th 
month of service is hypothesized to be a function of residualisation. 
That is, those who found their jobs dull tended to get out in greater 
numbers than those who found their jobs interesting. One might assume 
that the jump in the curve simply reflects a change in attitude, by 
individuals after they decided to reenlist; but this assumption is 
weakened by the observation that little or no jump occurs in the re- 
gression curves for many ladders. Regression curves for other ladders are 
shown in Figures 9, 10, and 11. Where little difference is found between 
the level of the regression curve at the 48th and 49th month, it is 
assumed that efforts to make jobs more interesting may have very little 
impact on retention. Such is the case for the 687X0, Programmer, where 
individuals who left the service evidently were finding their jobs as 
interesting as those who reenlisted. Perhaps some other factor, such as 
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pay in service compared with expected pay in comparable civilian lobs" 
would demonstrate a larger "impact gap." if so, the service might better 
improve retention by special pay benefits, or by educating workers con- 
cerning the reality of pay differentials. 

^Hopefully, we will eventually come up with more direct measures of 
the impact of job attitudes on retention. ' In the neantime, regression 
analyses, such as those described above, will provide clues as to what 
tactors may influence career decisions in each ladder. 

«v.i J*"^ f*"*" °^ satisfaction program, which is the most 

exciting, will be an attempt to find out what changes in jobs and job 
conditions will produce positive changes in those attitudes which 
influence reenllstment decisions. Here the military services are in an 
Ideal position to provide answers. Since jobs and job conditions are 
trequentiy changing, we can conduct Time 1 - Time 2 studies in which we 
attitudes ''^^^^^ conditions to changes in expressed 

Of course we recognize that changing jobs and job conditions is not 
the only approach to enhancing job satisfaction. Proper selection and 
Classification actions can contribute toward future job satisfaction. 
This is not a neglected area of research, but time is not sufficient 
enough to discuss it here. Nor can the various theories of job satis- 
faction and this relationship to our research be discussed. An 
excellent paper on the Implications of theories for Air Force job satls- 
tactlon research Is currently In press (Tuttle & Hazel, 1973). 

As mentioned earlier, factors related to job content, assignment 
preference, and worker-supervisor Interactions are among those frequently 
cited by personnel for their decisions to leave the Air Force. We are 
currently conducting an extensive study of the preferences of individuals 
tor assignment locations. I can report that most Individuals express 
iiSL positive and negative valences for particular assignment 

location^. If the services cannot assign Individuals to their most 
preferred location, perhaps they can at least avoid assigning them to 
locations for which they have a strong negative valence. 

The natter of supverlsor-worker relationships Is multi-faceted, and 
we will study each facet separately. One matte, which should be of 
concern to all services is that of supervisory incompetency. We have 
evidence that occupational structures and personnel assignment practices 
can create situations where first-line supervisors have had no direct 
experience on critical tasks being performed by their subordinates. 
i\tf^^ t * particular danger of this occurring in complex career ladders 
involving numerous Job types or having varied equipments to maintain. 
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SUMMARY AND CLOSING REMARKS 



Recommendations, based upon experience, which I would make to any 
organization planning a large-scale j6b analysis system based on 
administration or task-level job inventories are: 

1. Use full-time inventory writers ,to develpp t^k lists and 
background questions. ^ ' ' 

2, Write specific task statements, rather than broad task state- 



ments 



^ 3. Include any background items which might answer questions 
asked by managers of the personnel system. 

4. Collect worker name and identification information. 

5. Administer inventories to large samples. 

6. Collect data on optical scanning sheets. »^ 

7. Use a "relative time spent" scale as the primary/ rating factor, 
and convert ratings into percent time estimates. 

8. By all means, obtain and use the CODAP system if at all possible. 
You can modify it to your needs, but it will be expensive and time 
consuming to build your own analysis system. 

9. ^istablish an occupational research group to develop applications 
of occupational data in your military service. or organization. 

Thank you for the opportunity to participate in this sympo^siiim. 
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APPENDIX 

The following pages present a brief description of selected 
CODAP programs » along with example printouts produced by the CODAP 
aystea» as follows: 

1. The first four pages of a seven-^page Consolidated 
Job Description. 

2. Abbreviated Job Difference Description. 

3. A sample Individual Job Description. 
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DESCRIPTION OF SELECTED CODAP PROGRAMS 

CODAP: COMPREHENSIVE OCCUPATIONAL DATA ANALYSIS PROGRAMS 

CODAP is a computerized occupational data analysis system which Inputs 
and performs calculations upon raw data from Job Inventories, It Is designed 
to furnish users with a wide variety of reports that facilitate the Identifi- 
cation of Individual and group ^ob characteristics and the detection of be- 
tweea-job similarities and differences. 

INPSTD: RAW DATA EDITING AND INPUT 

This program reads task titles, task responses, and background data frcwa 
tape or card input. It edits the data, converts the raw task responses to 
percentages, constructs data vectors for each case, reorganizes the data to 
a standard history data format, and writes the formatted data on the output 
tape for use in subsequent programs. INPSTD will accept a maximum of; 928 
background and/or computed variables, 1000 task variables, 26 duty variables, 
20,000 cases, and 927 non-zero task responses per case, 

JOBDEC: CALCULATING COMPOSITE JOB DESCRIPTIONS 

This program calculates and prints composite job descriptions for groups 
formed during the hierarchical grouping process (JOBGRP) or for special 
gro'os whose membership is defined in terms of some combination of background 
or computed variables (JOBSPC). Both duty and task job descriptions may be 
reported in high to low sequence of either "average percent time spent by all 
members" or "percent of members performing." (A duty is a functional area 
comprising a number of tasks and, hence, is a summary report.) 

A job description produced through JOBDEC provides the following informa- 
tion: duty/ task number, duty/ task title, percent of members performing each 
duty/ task, average percent time spent by members performing, average percent 
time spent by all members, and cumulative average percent time spent by all 
members* 

GRPSUM: SUMMARIZING JOB DESCRIPTIONS 

This program calculates and prints a report of either the percent of 
members performing each task in the job inventory or the average percent time 
spent on each task by all members for any number of groups whose composite 
job descriptions were computed by JOBDEC or JOBSPC. The summarized data is 
printed in task number order and the group descriptions are ordered according 
to the sequence of the input request cards. GRPSUM does not print task titles, 
as does PRIJOB, nor does it have PRIJOB^s facility to specify criteria for 
excluding tasks from the summary report, 

GPSUM: SUMMARIZING JOB DESCRIPTIONS (FORMAT 2) 

This program is a version of GRPSUM containing certain features adapted 
from PRIJOB. Like GRPSUM, GPSUM2 c Iculates and prints a report in duty/task 
order of either the percent of members performing each task in the job inven- 
tory or the average percent of ^bjie spent on each task by all members of 
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groups whose composite job desciptions were computed by JOBDEC or JOBSPC. 
Whereas, GRPSUM prints no task statements and carries all percentages to three 
decimal places, GPSUM2 does print task statements and rounds off all oercenta^es 
to whole numbers. 

PRIJOB: CALCULATING PRDIARY JOB IDENTIFIERS 

This program calculates and prints a report of those tasks which are de- 
termined to be "primary identifiers" of job types. Primary identifiers may be 
defined as the top x-number of tasks in a group Job description in terms of per- 
cent of members performing or average percent time spent by all members. Pri- 
mary identifiers may also be defined as those tasks performed by a specified 
minimum percentage of the group members or which exceed a specified average 
percent time spent value. This program allows a number of groups to be aligned 
in a single report for comparative purposes. 

JOBIND AND INDJOB: CALCULATING INDIVIDUAL JOB DESCRIPTIONS o 

The JOBIND program calculates and prints job descriptions for individual 
cases* Both duty and task descriptions may be reported. Output will be task 
statements sequenced from high to low percent time spent, together with their 
percent time spent values and cumulative percentages. Selected background in- 
formation may ^Iso be printed at the top of each description. JOBIND has six 
options for selecting cases: (1) by last two digits of service number; (2) 
by every Nth case beginning with a specified KPATH sequence number; (3) by 
meeting specified requirements on one to nine background variables; (4) by 
membership in a specified job type group; (5) by case control number; (6) ran- 
domly, using a random number generator. The selected descriptions may be 
sorted in KPATH order, in random order, by background variables, or In case 
control number order* The six options for selecting cases may also be used to 
create new categorical membership variables which are inserted in the variable 
dictionary as computed variables. 

The INDJOB program also calculates and prints individual job descriptions, 
but prints only task identification numbers and percent time spent values for 
duties or tasks in duty /task sequence* A single report prints information for 
all cases in a columnar format. There are only three options for selecting 
cases: (i) by case control number; (2) by meeting specified requirements on 
one to nine background variables; (3) by membership in a specified Job type 
group. INDJOB has no sort options. 

GRPDIF: DIFFERENCE COMPARISON BETWEEN JOB DESCRIPTION? 

This program calculates and reports the difference between two job de- 
scriptions in terms of percentage of members performing each task and/or 
average percent time spent. Difference values are presented in ascending 
or descending order on either value (from largest negative to largest posi- 
tive difference or vice versa) or in task number order. 

AUTOJT: AUTOMATED JOB TYPE SELECTION PROGRAM 

This program calculates, evaluates, and reports between-group differences 
for specified pairs of groups whose job descriptions were computed by JOBDEC 
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or JOBSPC. Six comparison options are used: (1) differences in average per- 
cent time spent on each task; (2) differences in average percent time spent on 
each duty; (3)* dif ferences in percentage of members performing each task; (4) 
differences in number of tasks accounting for a major portion of average ler- 
cent time spent; (5) differences in number of duties accounting for a major 
portion, of average percent time spent; (6) differences in average number of 
tasks performed. As many as 850 pairs of groups can be compared in one run of 
AUTOJT. 



VARSUM: SUMMARIZING BACKGROUND AND COMPUTED VARIABLES 

This program computes and reports frequency distributions within specified 
intervals, makes total frequency counts, and calculates means and standard 
deviations on selected background and computed variables for any group of indi- 
viduals whose job description has been generated by JOBDEC or JOBCPC. VARSUM 
can process data on as many as 20,000 cases* 



DIST2X: COMPUTING A TWO--WAY DISTRIBUTION 



This program distributes a group of individuals on two variables (a row 
variable and a column variable). The group distributed may be the total sample 
or the cases coded "1" or "0" on a categorical membership variable. The row 
and column variables may be alpha or numeric, and intervals of unequal width 
may be defined for any variable. The data presented may be frequencies within 
cells or frequencies and percentages within cells. The percentages are computed 
based on individual row frequency totals, or on individual column frequency to- 
tals, or on the total N for all rows and columns. Any or all three sets of per ' 
centages may be displayed in the two-way table. A "total" category for rows 
and a "total" category for columns is automatically included for percentages 
and/or frequencies. The total number of cases counted and the total number of 
valid cases are given for each row and colunu'. and for total rows and total columns. 
Valid cases include all distributed numeric data. Only valid cases are used in 
the computation of means and standard deviations. Optionally, an "other" cate- 
gory may be included for rows and columns. Inclusion of the "other" category 
causes all numeric data to be counted as valid. Another option provides for the 
computation of means and standard deviations for individual rows and total rows 
and/or individual columns and total columns. Only cases defined as valid are 
used in computing means and standard deviations. A summary of selected informa- 
tion appears at the end of the report. Any number of reports may be generated 
in one program execution. 

AVALUE: CALCULATING AVERAGE VALUE 



For each task in a job inventory, this program calculates and prints the 
mean and standard deviation of a selected background or computed variables, 
using all valid responses of individuals in a specified group who perform the 
task. Task titles and the number of valid respondents on each task are also 
reported* Average values are optionally sequenced from low-to-high average 
value, high- to-low average value, or in task number order. Tasks with fewer 
than x-number of valid respondents may be removed from the main report to a 
supplementary report. AVALUE can be calculated for any group of inJividuals 
who can be identified on some range of a background or computed variable or by 
the intersection of up to nine variables* 
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TSKNDX: CALCULATING AVERAGE TASK RATINGS 

This program has the same options as AVALUE, except that it is used with 
task ratings rather than with background or computed variables. TSKNDX can also 
provide the following additional task information not available in AVALUE: (1) 
percent of members performing; (2) average percent time spent by inembers perform- 
ing; (3) average percent time spent by all group members; (4) cumulative sum of 
average percent time spent by all group members. TSKNDX is primarily used to 
compute average task difficulty ratings. 

RXXNDX: CCMPUTING INTERRATER RELIABILITY 

This program computes and reports for a group of raters the average inter- 
rater reliability coefficient of a single rater and the stepped up reliability 
coefficient for the total group of raters. The program is most often used in 
conjunction with sets of task difficulty ratings made by a large number of super- 
visory personnel. 

TSKDST; DISTRIBUTING MEANS AND STANDARD DEVIATIONS OF TASK RATMGS 

This program computes and reports the distribution, mean, and standard devia- 
tion of the mean task ratings and the standard deviations of the ratings for each 
task. The input to TSKDST is the punched output furnished by TSKNDX^ 

ASFACT; REPORTING SECONDARY FACTOR DATA 

If the tasks in a job inventory are rated on a second scale such as "amount 
of training required," the data is handled through the ASFACT program. The ASFACT 
program reports the following information on each task for any group of individuals 
whose Job description has been computed by JOBDEC or JOBSPC: (1) frequency dis- 
tribution o£ members responding on the secondary factor (0 to 9 scale); (2) total 
number of respondents; (3) number of respondents with values outside the specified 
range; (4) arithmetic mean and standard deviation of acceptable responses. 

VARGEN: COMPUTING NEW VARIABLES 

This program calculates new computed variables by applying input data to th^e 
task valutas of each case. The task values may be time spent percentages or "do - 
don't do" values Q,0). The input data consists of a vector of weights, a scaling 
(standardizing) factor and a specified calculation formula (five options). A 
newly created variable is given a variable identification number and is added into 
t\ e computed variable portion of the case data records on the history data tape. 

PREGEN: GENERATING NEW PREDICTORS 

This program creates new computed or background variables for input to other 
CODAP programs, principally the correlation and regression program (CORREG) accord- 
ing to certain standardized options, as follows: the new variable can be the sum 
ot two variables, the difference between two variables, the product of two variables 
or ti'fi ratio of two variables. Each option allows for adding a constant if so 
desired. Variables may also be created by setting certain values of a variable 
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out of range and then, either leaving these values unchanged during the genera- 
tion of the new variable, or setting them equal to zero or to some constant. 
This option is most frequently used to enable the selection of a specific sub- 
sample of cases by creating a categorically coded membership variable representing 
in-range and out-of-range cases ("1" or ''O/' respectively). Variables created at 
an early point in the program run may be used to create additional variables at 
some later point. Up to 500 variables can be created in a single PREGEN run. 

CORREG: CORRELATION AND REGRESSION PROGRAM 

This program package extracts up to 100 computed and background variables 
from a CODAP KPATH or history data tape and computes correlation matrices and 
regression problems. 

The correlation program computes and prints the correlation matrix, number 
of valid and invalid cases in the sample, and means and standard deviations of 
variables. These same computations are also put on tape for future reference, 
and they also remain in core if they are to be fed into the regressi^on program 
immediately* 

The regression program has two options. One option computes regression 
equations for various combinations of full and restricted models and evaluates 
the difference between full and restricted models with' an F-test, The value 
and the probability of the computed F-ratio are reported. 

The second option is designed as an aid to building an appropriate regression 
model. In this option, a series of regression problems is computed iteratively. 
Beginning with the best combination of three predictors at ite>ation 1, the best 
remaining combination of three predictors is added to the model at each subsequent 
iteration. The "best remaining combination" is that v^ich adds the most to the 
value of R2 when used in conjunction with all combinations of predictors selected 
at previous iterations. Predictors may be used more than once during the iterative 
process. Iterations are continued until the increase in the value of R2 over the 
previous iteration is less than some amount specified by the requester. Variable 
id's, R2 values, and the error sum of squares are reported for each iteration. 
The standard and raw score weights for each variable as they exist upon completion 
of the final iteration are reporte4, as well as the regression constant. 

Either one or both regression options may be requested at the same time, 

OVRLAP.: RELATING RESPONSES TO EACH OTHER 

This program generates an overlap or similarity matrix of all possible paired 
comparisons between individual cases. Similarity is expressed as a percentage of 
common tasks performed (TSKOVL) or as the total overlapping percentage of time 
spent on tasks (TIMOVL), Overlap in terms of percent time spent is the preferred 
option in most studies, OVRLAP can handle up to 2,000 cases and 1,000 tasks. 

* 

GROUP: CLUSTERING INDIVIDUALS AND GROUPS OF INDIVIDUAJ.S 

This program uses the similarity matrix computed in the overlap (OVRLAP) pro- ' 
gram to form clusters ^of cases. The grouping technique, called "collapsing the 
matrix" or "hierarchical grouping," involves repeated searching for those 
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individuals or partially formed clusters which have the highest (or lowest) ie- 
maining similarity, depending on whether a "maximizing" or "minimizing" process' 
was requested. The "maximizing" option is always used for Job survey data. 

Each new clustering or "collapse" is called a "stage" and the vectors of 
similarity values for the clusters being merged are combined according to a 
specified mathematical algorithm to form an integrated cluster. Several formulas 
for combining groups are available. The collapsing process continues until a single 
group has formed which contains all cases in a study. 

KPATH AND PRKPTH: ORDERING A HISTORY DATA TAPE AND 
PRINTING A HISTORY DATA REPORT 

After OVRiJVP and GROUP have been completed, the KPATH program assigns sequence 
numbers to individual cases in such a way that each pair of individuals or groups 
which are merged during the grouping process will have a contiguous block of KPATH 
sequence numbers. 

PRKPTH enables the user to select variables and printout formats to produce 
a report of. the case data values for the selected background and computed variables. 
The data to be printed is obtained from a history data tape which may be in case ID 
or KPATH order. The data is not sorted and therefore the output will be in case ID 
or KPATH order. 

DUVARS: COMPUTING A DUTY VARIABLE FOR EACH CASE 

This program uses task data to compute duty values for each case and displays 
the duty values in the form of a PRKPTH. Three duty variable options are avail- 
able: (I) perce'it time spent in each duty by each case; (2) number of tasks per- 
formed In each d^ty by each case; (3) percent of tasks performed within each duty 
by each case as a function of >is total number of tasks performed. This program 
is used principally as an aid in selecting meaningfully different Job-type groups. 

GRMBRS: REPORTING GROUP MEMBERSHIP 

This program produces an information report that identifies the two groups 
combining at each stage of the . ierarchical grouping process. The information 
IncJudes the stage number, the number of members in the combined group, the number 
of members in each of the combining groups, range of KPATH sequence numbers for 
the combining groups, the average percentage of overlap between the members of the 
combining group-, and the average percentage of overlap within the combined group. 

DIAGRM: GRAPHICAL PRESENTATION OF HIERARCHICAL GROUPING ACTIONS 

This program uses data from the GRMBRS program to generate a treelike diagram 
that visually displays the order in which gioups merged d ing the hierarchical 
grouping process. Each group is represented by a rectangu. ar block of data con- 
taining the same inf ormatJ .n found in GRMBRS. Rows and columns of asterisks show 
the branches leading from a group to its subgroups. Control cards can be used to 
limit the number and type of groups displayed by DIAGRM. 
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MBROVL: OVERLAPPING INDIVIDUAL JOB DESCRIPTIONS 
WITH A COMPOSITE JOB DESCRIPTION 

This program computes the overlap ol Individual Job desci iptiuns with the 
composite job description for the group and reports the Individual overlap values, 
their mean and standard deviation, and an array of selected background data for 
each case. The format of the report is similar to PRKPTH, except that the cases 
are sequenced from highest to lowest overlap with the composite job description 
and only cases that are members of the selected group are included. Reports on* 
a number of groups can handled in one program execution. This program is use- 
ful in studying the homogeneity of membership in a group whose composite job , 
description was computed by JOBDEC or JOBSPC. 

MTXPRl: PRINTING AN OVERLAPPED MATRIX 

This program calls for the subroutine OVRLAP to overlap all possible pairings 
of a set of composite (group) job descriptions and then uses the program MIXPRT to 
print the between-group overlap values in matrix form. Overlap may be computed 
in terms of average percent time spent on tasks or in terms of number of tasks 
performed in common. The maximum number of groups that can be input to MTXPRl is 
100. 

JD2HDT: ADDING JOB DESCRIPTIONS TO HISTORY DATA TAPE 

This program adds average job descriptions for groups to a history data tape 
as additional cases. Each of the new composite cases is given the next sequential 
case control number. 

PRDICT: PRINTING DICTIONARY OF VARIABLE TITLES 

This program prints a report containing the Identif icanlon codes and descrip- 
tive titles of all background and computed variables peculiar to a particular 
study. .The identification codes are used in calling for data to be reported by 
the PRKPTH and VARS^UM programs, or to be acted upon by the VARGEN, PREGEN, PROGEN, 
JOBIND, AVALUE, or TSKNDX programs. 

JOBINV: PRINTING OF DUTY AND TASK TITLES 

This program prints a listing of the duty and task titles included in a job 
inventory. The titles are listed in task number sequence within each duty, and 
the format calls for two columns per page. 

BCDEXT: REORDERING AND EXTRACTING REPORTS FROM THE BCD REPORT TAPE 

All reports generated by CODAP can optionally be placed on a BCD output tape 
for future recall. The BCDEXT program extracts reports selected by control cards 
from the BCD file, prints them out in the same order as the input requests with 
continuous page numbering, and furnishes a table of contents with page number 
references. » 
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PROGEN: PROGRAM GENERATI(»1 PROGRAM 

This program permits the CODAP expert to add, extract, and manipulate data 
In the CODAP system In ways not encompassed by the standard CODAP programs and 
do so with a minimum amount of additional prograianlng and without requiring 
thorough Indoctrination In the CODAP system. PROJEN uses a combination of FORTRAN 
statements and shorthand operation codes to generate a special purpose program to 
read the KPATH or history data tape, 'either of which contains the entire data file 
for each case, and perform operations upon It. New variables can thereby be created 
and added to the CODAP variable dictionary. This program also has the facility to 
reconvert percent time task values for each case to the original raw response form, 
perform operations on the raw responses, and convert them back to percentages* 
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TASK MB DESCRIPTION FOR JOURNEYMEN MEDICAL LABORATORY SPECIALISTS (N-3M) 



aiM;X\TIVESUM(>F AVERAGE^ERCENTTIMESFENTBY ALLMEMBERS • • • 

AVERAGE PERCENT TIME SPENT BY ALL MEMBERS 

AVERAGE PERCENT TIME SPENT BY MEMBERS PERFORMING 

.'ERCENT OF MEMBERS PERFORMING 

• • • • 

l> TSK TASK TITLE ... 

I IH Coitcct Blood Spectmcm Directly from Patients 93.40 1.70 ME Ii8 

3 ^ Perform Blood Counl 89.09 IJ6 1.39 2,98 

i 17 Perform Hemalology Procedures for DiffeienliaJ Cell Counts 88.83 1,49 1.33 4.30 

J 24 Perform Hcmalolojy Procedures for Hemitocnl Tests 89.09 1.45 1.30 5.60 

N 2 I xaminc Urine Specimens Mtaoscopicaliy 88.07 1.43 1.26 6.85 

J 5 Prepare Blood Smears 89.85 .1.39 1.25 8.10 

I 10 Preptrc and Procus Specimens 87.56 1.39 1.22 9.32 

N 9 Perform Urinalyw for Glucose Tests 87.82 1.38 1.21 10i3 

N IS Perform Urinalyses for Specific GravilyTcsis 87.06 1.38 1,20 11.73 

N 6 Perform Urinalyses for Albunvn Tests 87.06 1.36 1.19 12.92 

I 3 C lean Area and l.q«pmenl Asepticiliy 80.96 1.46 1.18 14.10 

N I I xamine Urine Specimens Macroscopically 87.82 1.32 1.16 15,26 

J 6 Separate Serum from Blood 87.31 1.30 1.14 16.40 

I M Prepare Rcaients « 93.40 1.19 1.11 17il 

J 2 Identify Morphological Variations of Blood Cells ' 88.07 1.21 1.06 18i7 

M 4 Operate Spectro*Photometer 77.66 1.34 1.04 19.62 

J 21 Perform Hematology Procedures for Erythrocyte SedimenUtion Rate 87.56 1.19 1 04 20.65 

K 7 Perform Serologica! Procedures for Cardiolipin Micronoeculition 78.93 1 .30 1 .03 21 68 

(« I i xa mine Specimens Micro<xopi call y * 86.04 1.18 1.01 22.69 

(; 2 identify and Classify Pathogenic Bacteria 78.68 1.27 1.00 23.6*^ 

C; 10 Preparc( ulture Media 78.68 1.26 0.99 24.68 

12 Prepare Solutions and Standards 86.55 1.09 0.94 25.62 

M 25 Perform Biochemical Procedures for Liver Function Tests 78.93 M. 18 0.93 26i5 

M 27 Perform Biochemical Procedures for NPN and BUN T^sts 79 1.16 ' 0.93 27.48 

(; II Stain Bacteriological Smears 85.28 1 08 0.92 28.41 

I 3 Crossmatch Blood 72i9 1.24 0.90 29.30 

I 16 Tost BI{H>d for ABO Grouping and ABO Subgrouping 80 20 1.12 0.90 30.20 

J 1 iikntify Immature Blood CeUs 86,29 1.04 0.89 31.09 

I 2 I saimnv Specimens Microscopically 81.47 1.08 0.88 31.97 

(; 6 Perform Antibiotic Sen<itivity Test 75.38 1.17 0.88 32.85 

1 14 Prepare Specimens fur Shipment 84.26 1.03 0.87 33.72 

I 3 Log Incoming or Outgoing Specimens 7 1.83 l.K- 0 83 34i5 

L IH Type BKwU o! Uonors and Recipients » 74.87 1* 0 0.83 35,38 

L 2 Centrifuge and Separate Seru»^ from Clot 73,10 l.ll 0^1 36.19 

M 33 Perform Biochemical Procedt . for Total Protem and A/G Ratio 75.13 1.06 0.79 36,99 

I 17 rest Blood lor RM O or DUhactors 76.14 1.04 0,79 37,78 

I. K Perlorm Direct and Indirect Coombs Tests * 75.38 1.04 0 7 8 38 i6 
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CDMt'LATIVESUMOF AVERAGE PERCENT TIME SPENT BY ALL MEMBERS . • • 

AVhRAGFPtRCENTTIME SPENT BY ALL MEMBERS ^ • 

AVERAGE PERCENTTIME SPENT BY MEMBERS PERFORMING • • • 







rr RC tNT Or MtMotRo rtlU'UKMInu 








« 
• 


i>rsK 


1 III LC. 








• 


M 


5 


Prepare Reagents and Standards 


75.38 


1.01 


0,76 


39.32 


J 


27 


Perform Hematology Procedures for Prothrombin Time 


79.19 


0.95 


0.76 


40.08 


J 


4 


Perform Spinal 1 luid Cell Counts 


84.52 


0.88 


0,74 


40^2 


1 


1 


1 xanune Specimens Maaoscopically 


79.95 


0.92 


0.73 


41^5 


1 


6 


Identify Protozoans, Cestodes, Nematodes, or Trcmatodes 


74,62 


0 95 


0,71 


42.26 


1 


19 


Collect I'ccal or Urine Specimens Directly from Patients 


52.79 


J. 33 


0.70 


42.96 


J 


28 


Perform Hematology Procedures for Reticulocyte Count 


84.26^ 


0^2 


0.69 


43.65 


N 


K 


Perform Urinalyses tor Bile Tcsti . 


85.28 


0.80 


0.68 


44.34 


1 


3 


Pert or m Concentration and Flotation Techniques 


72.84 


a93 


0.68 


45.02 


J 


13 


Perform Hematology Procedures for Coagulation Times by Capiilary Mctliod 


79.70 


0^5 


0.68 


45,70 


M 


34 


Perform Biochemical Procedures for Uric Acid Tests 


70.81 


0 96 


0.68 


46.37 


N 


3 


Perform Kidney F' unction Tests ^ 


76.14 


0.89 


0.68 


47.05 


J 


30 


Perform Hematology Procedures for Thrombocyte Count 


80.46 


0^3 


0.67 


47.72 


J 


14 


Perform Hematology Procedures for Coagulation Times by Lce-Wliite Method 


82.23 


0^1 


0.66 


48.38 


M 


37 


Utilize Methods for Colormetric Procedure 


52.C3 


1.25 


0.65 


49.03 


J 


II 


Perform Hematology Procedures for Cerebrospinal Fluid Count 


80.96 


0.80 


0.65 


49.68 


M 


32 


Perform Biochemical Proceduies for Total Cholesterol and Esten Tests 


68.27 


0.93 


0.63 


50.32 


M 


17 


Perform Biochemical Procedures for Chlorides Tests 


71.07 


0,89 


0,63 


50.95 


N 


12 


Perform Unnalyses for Oa'ult Blood Tests 


82,49 


0.76 


0,63 


51.58 


i 


5 


Maintain F lies of Chnical Laboratory Requests 


54.82 


1.14 


0,63 


52.20 


J 


8 


Perform Hematology Procedures for Bleeding Time, Duke Method 


71.83 


0.36 


0.62 


52.82 


M 


38 


Utibze Methods for Flectrolyte Determinations 


61.68 


1.00 


0.61 


53,43 


J 


20 


Perform Hematology Procedures for Frythrocytc Indices* 


79.44 


0.75 


0.59 


54,03 


M 


n 


Perform Biochemical Procedures forCalaum and Phosphorus Tests 


64.72 


0.92 


0.59 


54 62 


1 


7 


Maintain 1 iles of Laboratory Records or Reports 


51.27 


1.14 


0^9 


55.20 


J 


25 


Perform Hematology Procedures for L E. Test • 


75.38 


0.77 


0^8 


55.79 


I 


5 


Draw Blood for Transfusions 


64.47 


0.90 


0^8 


56.36 


K 


13 


Perform Serological Procedures for Hetcrophik Presumptive and Differential 












Antibody Test 


63.45 


0,90 


0^7 


56.94 


J 


18 


Perform Hematology Procedures for Fosinophilc Count 


80.46 


0.71 


0^7 


57.51 


M 


2 


Operate l lamc Photometer 


64.97 


0^8 


0,57 


58.08 


c; 


8 


Perform Sperm Counts 


79.44 


0.71 


0.57 


58 65 


J 


29 


Perform Hematology Procedures for Sickle Cell Preparations 


82.74 


0.68 


0,56 


59.21 


M 


14 


Perform Biochemical Procedures for Carbon Dioxide Determinations 


67.26 


0^3 


0^6 


59 77 


I- 


11 


Receive Inroming Supplies 


55.58 


0.96 


0,53 


60.31 


! 


IS 


Store Blood According to Grouping and Factor 


59.90 


0^9 


0^3 


60^4 


1 


20 


C ollect Pus Specimens Directly from Patients ^ 


65.99 


0^0 


0,53 


61.37 


N 


20 


Perform Urinalyses for Urobilinogin Tests 


75.89 


0.66 


0,50 


61.87 


K 


14 


Perform Serological Procedures for Latex Fixation Te^t 


59.64 


0.84 


0.50 


62.37 


K 


6 


Perform Serological Procedures for'C* Reactive Protein Tests 


161.42 


0.80 


0.49 


62.86 


II 


4 


Perform KOH Preparation for Dermatophyte 


68.02 


0.72 


0 49 


63.35 
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C UMULATI VI SUM Oh A VfcRACfc PtRCtNT TIME SPENT BY ALL MEMbERS 

AVI RAGE PERU NTTIMESPENT BY ALL MEMBERS 

AVERAGE PtiRCbNT TIME SPENT BY MEMBERS PERFORMING* • • 

PI RONT OF MEMBERS PERFORMING 



1>-TSK 


TASK TITLE 


• 
* 


• 




• 


4 

'\ 


-lit 

"Hi 


iVvvk^p jnd Improve Work Mclhoii\and Procedures 


5335 


0.91 


0.49 


63.84 


1 


A 


Disfxne of BlootI Alter Time Limit 


62.18 


0.7'» 


0.48 


64.32 


▼1 




Perform Bloihtniical Proteiiurev lor Blood Alcohol Tcsis 


66.75 


0.71 


0.48 


64.79 


M 




IVrl«irin Bi(K-heniK.>l Procedures for Creatinine Tests 


61.42 


0.76 


0.47 


65.26 


1 
1 


O 


Maintjin Donor I iles 


58.63 


0.79 


0.47 


65.73 


N 




Pertorm Urinulyscs for Kl TONC Studies 


55.33 


0.84 


0.46 


66.19 


II 


2 


1 Njmine Specimens Microscopii.'ally 


60.15 


0.77 


0.46 


66.65 


1 

J 




IVrlorni Hematology PriKedurcs for Clot Retraction Test 


73.35 


063 


0.46 


67.11 


A 
f\ 




Assure tin: Availahlity of 1 quipment and Supplies 


42.64 


1.06 


0.45 


67.57 


A 
fx 


2ft 


Rei|uisition Supplies and 1 quipment 


44.67 


1.01 


0.45 


68.02 




i z 


Requisition Suppbe^ 


44 42 


1.00 


0.45 


68.46 


M 


1 

• 0 


Perform Urinalyses for Total Protein 


63.45 


0.70 


0.44 


68.90 


M 

r* 


J. 1 


Pcrtorm Biochemical Procedures for 1 nzyme Analyses ^' 


46.70 


0.95 


0.44 


69.35 




4i 


Utilize Methods for Titnmctric Procedure 


55.33 


0.80 


0.44 


69.79 


M 


1 3 


Perlorm Biochemical Procedures for Carbohydrates Tolerance Tests 


44.67 


0.98 


0.44 


70.23 


M 


5 


Pa*parc(*ultua* Media 


57 87 


0.76 


0.44 


70.67 


if 


1 


Cultivate Mycology Specimens for Primary Isolation 


56.09 


0.77 


0.43 


71.10 


D 


6 


(iive ()n-The Job Instruction in Medical Laboratory Activities 


40 10 


1.04 


0.42 


71.51 


N 


7 


Terlcrm Urinalyses for Bencc-Jones Protein Tests 


68.78 


0.60 


0.41 


71.93 


t 


5 


Stain Parasitological Smears 


SSSl 


0.77 


0.41 


72.34 


1 


22 


Collect Skin Specimens Directly from Patients 


58.12 


0.71 


0.41 


72.75 


K 


K 


Perlorm Serologieal procedures forCokJ Agglutinations 


57.11 


0.72 


0.41 


73.16 




4 


Perlorm Pregnancy Tests 


48.48 


0.84 


0.41 


73.57 


( 


6 


1 valuate the Accuracy of Routine Reports 


39.09 


1.04 


0.41 


73.98 


K 


5 


Perform Serological Procedures for Antistreptoly • **0" Titers 


48.48 


0.82 


O.^^O 


74.37 


1 


13 


Record Information on Blood Record Card 


53.05 


0.74 


0.39 


74-77 


1 


7 


Mamtain 1 ilcs of Blot)d Bawimg horns 


53.30 


0.74 


0.39 


75.16 


1 




IVrtorm Preventive Maintenance on Laboratory 1 quipment 


47.72 


0.82 


0.39 


V5.55 


1 


24 


("olleet Sputum Specimens Directly from Patients 


52.28 


0.72 


0.38 


75.93 


1 


1 


Attach Scnal Numbers to Units 


48 22 


0.78 


0.38 


76.30 


M 


1 


Calibrate Instruments 


52.03 


0.72 


0.37 


76.68 


1 


14 


Screen and Schedule Dopois ~ — ^ 


50.51 


0.72 


0.36 


77.04 


N 


5 


Perform Unnalysesfor AddisCounts 


63.96 


0.56 


0.36 


77.40 


(* 


t 


Determine 1 quipment Repairs or Replacements Needed 


47.21 


0.76 


0.36 


77.76 


() 


9 


Prepare Specimens for Shipment 


39.85 


0.89 


0.36 


78.12 


1 


li 


Prepare Blood for Shipment 


46.70 


0.72 


0.34 


78.46 


M 


40 


Utilize Methods for Ciasometnc Procedure 


41.37 


0.81 


0.34 


78.79 


K 


it 

21 


Perlorm Serological Procedures for 1 ebnie Agglutinations 


45.69 


0.72 


0.33 


79.12 


A 


PKin Reports for the Section 


32.99 


0.99 


0.33 


79.45 


1 


4 


Maintain and Rcvim; Stock Levels 


35.53 


0.92 


0 33 


79.77 


A 


20 


Plan Record Keeping for the Section 


30.71 


1.06 


0.33 


80.10 
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1 1 Ml I.XTlVb SIM 01 AVtRAGh PERCENT TIME SPtNT BY ALL MbMBERS 

\\hR \(;t PfrRCLNTIIMtSPFNT BY ALL MEMBERS 

\V>R \(;ii PtRCFNTTIMt SPhNT BY MEMBERS PERFORMING ... 
ri^RONrol- Ml-MBCRS PERIORMING 



I 

M 

I 

M 
N 
\ 



7 
14 

W 
X 

4 

I- 
I ^ 
I 



V) 
s 

14 

\^ 

H 
I! 

4 

*t 
IH 
IH 
2'' 
If.. 

H 
IS 



T\SK TITLt • • • 

l\rtorii. IK*niatolt»gv PriKcdorcs \ot I ryihrocytc I raplity Tests 5914 0J5 0.32 80 42 

Pi ftiirni Bkk hcnut jI PriKcdurcs for Serum \ rog Test for PrcgnaiKy 40.61 0.78 0.32 80.74 

IVrtorm BattcnologiLjIorrhcmitall xaminations of Water 41.37 0.74 0 31 81.05 

Stain MyioU)«> SpiLimcns 48 22 0.62 0.30 81 34 

Pafor..! I nnalvscN lur Trtnary Cakium 54.57 0.54 0.30 81 64 

Pcrrorm trinal>scN fur Porph> r ins Tests 54.57 0^4 0.30 81.94 

Maintain Stock < ullurcs 35.79 0^2 0.29 82 23 

I valualc the Ailojuatv of Routine Reports 29.44 0.98 0.29 82 5 2 

Suhrnil l*vsue SpcLimens to Al IP or Histupatholo|:> Centers 32 99 0.87 0 29 82.81 

( iHudinate Uorn Activities vMth Other SectKins 36J5 0.77 0.28 83.09 

I sfabhsh Proeediucs tor Speaai Tests 36.29 0.74 0.27 83.36 

r>iriLt Subordinates in Maintaining Performance Standards 3096 Oj87 0.27 83.63 

I'rixure and Store Biolopeall terns 35.53 0.75 0.27 83.89 

Idiniifv and ( UssU v I ungi 36.04 0.73 0.26 84 16 

Assist with Autopsv 39 34 0.66 0.26 84.42 

IV r form Hoc teriologieal or ChenneaM xaminations of Food Products 40j86 0.63 0.2& 84 67 

Pertormlirst AidforShotk 51.02 0.49 0-25 84.92 

tVpaie Antigens 32-49 0.77 D.25 85.17 

Prepare Specimens tor 1 raining or Reference 36 29 0 67 0.24 85.42 

Perform I rin^Ivses tor Phenylpyruvie Attd Test 46.95 0J2 0.24 85 66 

Supervise the Maintenance of laboratory Supplies 23 60 1.02 0.24 85.90 

OuvLt thtMatnicnanLe and I tSization of Equipment. Supplies and Work Space 27.92 0.86 0.24 86.14 

AsMKM SpceifiL V^otk to Individuals 30.96 0.78 0.24 86 38 

Resolve TeihRual Problems o> Subordinates 28.43 0^3 0.24 86.62 

Perform Hioehcniual Procedure , for Creatinine Clearance Tests 32.23 0.73 0.23 86j85 

Indottnnare NluI;. Assigned Personnel 35.28 0.67 0.23 87.09 

lnvestij!.itc Possible Sources of Staphylococcus Outbreaks 28.43 0.82 0.23 87.32 

Plan V^ork Mow 25 13 0.92 0.23 87 56 

I valuate %*»rk Performance of Subordinates 23.35 0.95 0.22 87 78 

Pert or ra HhH hemicaJ Procedures fo' Carbon Monoxide Determirutions 39.09 0^7 0.22 88.00 

Prepare! ultur. Media 29.70 0.73 0 22 88.22 

iXvelop or Rl im* the Organization of the Section 26.40 0.81 0 21 8S 43 

l)irr^.i Subi»rd!»ules in the Observantc of Safct> Practices 27.66 0.77 0.21 88 64 

Perform Hematology PrcKcdures for BIcedingTime J v>- Method 29.44 0.71 0.21 88.85 

Slum How to I ocate and Interpret Techmca! Information 25.89 0.78 0.20 89.06 

Pl.in ario S< heduk V»oik Assignments 24.1 1 0.83 0.20 89 26 

Perform BiochciniL.il Prtxredures for Sal»eylate Level 32.49 0.61 0.20 89 46 

K a om mend SfHTLijI Corrective Action for Recurring Problems 26*.65 0.72 0.19 89.63 

I -jIuatL the Maintenance and Use of Fquipment. Supplies and Work Space 23.86 OSO 0 19 89.84 

lVrft»rm I rmalvsis for Cririary ( hloridcs 35 03 0 54 0.19 90.03 
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SAMPLE DIFFERENCE DESCRIPTION 

GROUP 1 = APPRENTICE DENTAL LABORATORY TECHNICIANS |N=30) 
GROUP 2 = JOURNEYMAN DENTAL LABORATORY TECHNICIANS {N=272) 







DM 1 1 RI NC 1 IN n R( 1 M IM Kl OR\1|N(. (iROl F I MINIS CROUP 2 










I'l K( 1 M 1*1 Kl OKMIM. (.KOi 1* 1 






• 






I'lKCIM n Kl OKMIM.. (.KOI 1*2 




• 


• 


1) ISK 


1 VSKTin 1 




• 
• 


• 
• 


k 


1 } 


1% rt«>ilH IK lll.ll \>M>t.tlll 1 IIIUtHMlN 


12 87 


33 33 


20 47 


< . 




Mi\ .iiul l*Kp.iri SltJin W.iUt 


51 10 


70.00 


18 90 


ii 


14 


1 1 inK ( oiMffKiv lKiiliiri'> 


54 78 


73 33 


18 55 


\! 


(. 


M iiiil.iin HoiitMit 1 .ink > 


52 57 


70.00 


17 43 




Il» 


Mi\ Mr l*ripjic lhi|Mk.iliiK.' M.iU-rijU 


20.96 


36.67 


15 71 


1 


; 


TitlMr^ Mjlri\ tor D^iiliirc Kc|>jir 


54.41 


70 00 


1539 


M 


7 


M iiiit.iin iKhvtlr.iliitL' 1 i|iiipnu'nt ()vcn\ 


It 40 


26 67 


15 27 


II 


:n 


r \i i\ Ik I>^ nturtN 


54 78 


70.00 


15 22 


H 


h< 


( iir^ jiiJ Dill.isK ( tMtipk'U DcnltiriA 


55 51 


70 00 


14 49 


II 




1 run < 


55 51 


70 00 


14 49 


i 


:<» 
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Append ix (Continued ) 
EXAMPLE fNDiVIDUAL JOB DESCRIPTION 



CASE CTRL NUMBER 
NAME a 
GRADE 

TOT MOS AFMS 
NO' SUBORDINATES 
MAJOR COMMAND 
PRES WORK ASGNMT 
EDUCATION LEVEL 
PLAN TO RE ENLIST 
I FIND MY JOB 
UTIL OF TAL/TRNG 
JOB INSIDE US 
SUM TIME CIV PAY 
ORGANIZATION/BASE 



= 1 134 

= WITHHELD 
= E 3(A1C) 
= 015 
= NONE 

= AIR FORCE SYSTEMS COMMAND 
= CIVILIAN PAYROLL CLERK 
= 14 

= PROBABLY YES 

= FAIRLY INTERESTING 

= FAIRLY WELL 

= YES 

= 99.9910, 

^ AEROSPACE MEDICAL DIVISION AFSC BROOKS AFB TEXAS 
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FUNCTIONAL JOB ANALYSIS 



Sidney A, Fine 



The presentation of Functional Job Analysis to this distinguished 
group on the occasion of this Navy Symposium looking forward to occu- 
pational res'^arch in 1980, happens to coincide with the 25th anniver- 
sary of this methodology. All persons registered for employment at the 
United States Employment Service are classified and coded according to 
the functional job analysis method. Its debut occurred In a paper I pre- 
sented at the American Psychological Association In Chicago In 1948. 
The concepts In that paper were the outcome of my experience in developing 
Job families In the Employment Service to assist In the mobility and 
placement of clvllalns during World War II and the development of a 
military occupational classification along functional lines. Essent- 
ially, in both Instances, the object was to 'classify jobs according 
to their similarities in functional requirements of workers. The advan- 
tages for both worker and employer from the standpoint of flexibility, 
mobility, and maximization of training were clear. 

The challenge was hot' to articulate these functional skills and how 
to relate them to functional requirements of jobs. This was the 
theme of the -original paper and therein the research outlines for FJA 
were promulgated, later to become the Functional Occupational Class- 
ification Project of the United States Employment Service, a joint 
United States Air Force and Department of Labor undertaking. 

Initially FJA was developed as a method of job* classification in 
the employment service for u^e in placement, counseling and reporting. 
This was embodied in the 1965 third edition of the Dictionary of Occu- 
pational Titles* The main outlines of the classification system were 
completed in 1959. The FJA conceplfs were applied and researched in des- 
cribing and paying hard science personnel at the Applied Physics Labora- 
tory; in designing a rehabilitation workshop for schizophrenic patients in 
St. Elizabeths hospital; in measuring the impact of automation on job 
structure and worker health in several major manufacturing concerns; 
in designing a classification system for statistical reporting and place- 
ment of workers in developing countries under the aegis of the Inter- 
national Labour Office, and recently, in developing a system of train- 
ing manpower specialists to develop and design jobs for disadvantaged 
persons . 

In this last Instance, FJA became a component of a Systems Approach 
to Manpower Planning and Utilization. It is this format that was In- 
corporated in the National Task Bank of over 550 tasks in the social 
welfare Industry and that is currently being used in one degree or 
another in manpower planning in the welfare departments of perhaps 25 
states and numerous other public and private agencies. Two of the current 
applications are in an electrical manufacturing concern, where it is 
an Input to management counHeiliig; aud In a bank, wh^ic li !o tlie Uaota 
for ^icvoloplng an inf'^rj^rnroH personnel HyBtem. 
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Vhv' tht^rnt* of this presentation, suggested by my wife, follows 
this Zen saviiiK-- 

'*If you are going to walk, walk 
If you are going to sit, sit 
But above all, don't wobble." 

We laborers in occupational clAslfj cation are all trying to get 
rid of th# wobble in job analysis bqjiuse reliable and valid informa- 
tion about jobs is so basic to everything that needs to be done in 
manpower and personnt^l work. Doctors McCormick and Crystal try to get 
rid of the wobble of rather uncertain inputs by using statistics and 
computers. I try to get rid of it through the use of words to control 
perceptions at the source. I prefer words because when push comes to i 
shove, lob analysis is a means of communication and coimnunication is 
with words. I don't have to translate words into figures and figures 
back into words. Furthermore, values and needs are implicit in words 
and our organisation of them into messages. It is in these messages 
about work to workers, supervisors, and decision makers where we need 
to rind the ultimate explanation of our statistics anyway. In any 
casts lt:t me hasten to say that in my opinion all of us are still 
working around the periphery of the central problem, if the central 
problem is productivity and worker satisfaction and growth. In the 
main, we are all focusing on the work itself as though the worker, 
like some depersonalised thing, comes to the work place geared to 
rake his place and perform only those actions represented in a job 
description. This, of course, is not so. But nevertheless, there is 
something to he said for achieving clarity all>ut the work itself and 
for this none of us need to apologize. 

My presentation illustrated by the graphics on pages 71 to 75 
follows this outline: 

I. [will show you a Task Statement prepared according to FJA 
Technique and describe its structure. 

.^ [will describe how a Task Statement is controlled and how 
reliability and validity are achieved. 

3. I will present two of the operational FJA Task Statements: 
Performance Standards and Training Content. 

A, I will briefly discuss the task in the work situation. 

3. I will consider the place of the task in the System and 

somo applications therein. 

iV. '\ result, I hopt you will see the attempt to eliminate the wobble, 
the imix^rtanrf* of task rather than job, and finally that FJA in its 
prf^eni formulation is far more than a job analysis technique. It is 
notiiing less tf.an a total system of perceiving and thinking about 
pr>ple at work, even though some parts are as yet terra incognita. 



Vhv I'a^'.k St_.iremrMn 

Functional lob Analysis defines a task as follows: 

"A task is an action or action sequence grouped through 
timo, (iesiMncHi to contribute a specified end result to the 



accomplishment of an objective and for which functional 
hovels and orientation can be reliably assigned. The task 
action or action sequence may be primarily physical (such 
as operating an electric typewriter), or primarily mental 
(such as analyzing data) and/or primarily interpersonal 
(such as consulting with another person). 

From the first graphic, the important elements of a task state- 
ment can be seen, there are two such elements: (1) the action the 
worker is expected to perform; and (2) the result expected of the 
worker action. The action is: Types/transcribes standard form letter ; 
and the result expected is: To prepare letter for mailing . You will 
note that these two elements are separated by the prepositional phrase, 
"in order to." Additional material is included in the task statement 
which indicates the resources the worker draws upon for the task, and 
some Indication of the level of instruction, that is, the prescription/ 
discretion mix, that the worker must follow. 

This format for the task statement fulfills the definition of the 
task and answers the five basic questions that FJA asks as to the 
information the task statement is supposed to provide, namely: 

Who: 

What Action? 

To accomplish what immediate result? 
With what tools/equipment/work aids? 
Upon what instructions? 



In the task statement shown, the additional information is represented by 
the phrases: "including specified information from records provided, following 
standard operating procedure (SOP) fot form letter, but adjusting standard 
form as required, for clarity and smoothness." 



Controls 

Task statements are spoken of as controlled* This means that the func- 
tional levels and orientation can be reliably assigned as required by the 
definition. Levels and orientation are the two measures based on the worker 
function scales shown in this second graphic* The Worker Functions scales 
relate to data, people, and things. These scales, which are used in the 
DOT Classification System to classify all jobs in the American economy, 
purport to describe all the possible things that people can do to get work 
done. The scales are ordinal; that is to say, any function in the 
scale includes the functions below, and exclude the functions above. The 
method for using these scales is to assign one function from each scale - 
the highest applicable in each instance - to any given task. This is done 
on the theory that a whole person is functioning in every signle instance, 
and, he is functioning physically, mentally, and interpersonally in 
relation to some type of data, people, and things input, although the mix 
of these three may vary considerably. Thus, in the task shown in the 
first graphic, the three relevant functional levels are: compiling (for 
data); taking instructions (for people) ; and operating/controlling (for 
things). By selecting these three functions for this task, the worker's 
relationship to all possible functions, all possible actions workers can 
do are indicated. This is the level measure. The orientation measure 
seeks Co show the relative involvement of the worker with data, people 
and things, the total being 100%. The convention used is to indicate this 
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in units of 5% an^ assigning at least 5% where hardly any involvement is 
indicated. This is done on the theoiy that the whole person is involved 
even if you can't see it. The orientation percentages are 70Z for data, 
5% for people, and 25% for things. The primary involvement in this task 
is considered to be data, the secondary involvement things, with the people 
involvement being negligible. The 70% assigned to data signifies that 
even though this task involves workers with a typewriter, on a continuous 
basis, the standards on the basis of which this worker will primarily 
be judged in this task are data standards. 

There are four more scales, all of whic^h appear in the brochure 
Functional Job Analysis Scales: A Desk Aid , From the other information in 
the task, using these other four scales, it can be determined that this worker 
is functioning on an instructional level of 2, a reasoning level of 3, 
a math level of 1, and a language level of 4. Now the important thing 
about the ratings is that they can be reliably arrived at, which is 
part- of the definition for a task. What this means is, that any group of 
people looking at this task individually would assign approximately tha 
same ratings for this task. This is what is meant by a controlled task 
statement. 

Operational Inferences FJA Task Statements 

The original task statement shown in the first graphic/and the 
superimposed message on it must be noted. 

"To do this task, to these standards, the worker needs this training.** 

From an explicit t::^ic statement it is possible to derive two types of 
performance standaids - (1) descriptive standards; and (2) numerical stand- 
ards. Although stated somewhat generally, these standards derive directly 
from the task statement itself. There is no great leap into recondite or 
abstract concepts. In methodology, one uses both types of performance 
standards, because he recognizes the potential of descriptive standards 
to cover the wholeness of a performance, and the numerical standards to 
clover very limited, measurable aspects of a performance. 

When a task is explicitly stated in this form, when it is controlled 
for reliability, and from which performance standards of the type indicated 
can be fonnalated - then it is possible to express the training required. 
Here again are noted two types of training - (1) the more generalized or 
functional training; and (2) the specific content training relating to the 
particular work situation in which the task occurs. Another way to think 
of these two types of training is that the functional training is the general 
training which the person brings to the job, whereas the specific training 
relates to the skills lie acquired in the particular establishment in which 
lie is working, on--the-job-training. These statements refer directly to the 
standards and to the task, and together the three areas of information 
fprn a whole, sunmiarized by the concept that to do this task to these 
standards the worker needs this training. When one examines these three types 
of intormation it is noted tnat the task statement focuses on verbs, 
the performance standards on adjectives and adverbs, and the training 
content on nouns. 
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The Task in the Work Situation 



In this graphic and the one that follows, note the task, the unit 
of observation, in the larger context of the work situation. In FJA 
the behavior or worker action phrase is ultimately expressed in tems 
of Things, Data, and People functions. It is a resultant of worker 
qualifications. The worker can perform the task at 'the specified level 
of functioning and the standards required because of his aptitudes, his 
basic generic skills in reading, in math and language, and on top of that 
his training and experience. When one looks at the aptitude profile re- 
quirements developed with tests like the General Aptitude Te,st Battery 
(GATB) he will find that a dominant function or combination of functions con 
sistently calls for similar patterns of minimum aptitudes, FJA is as good 
a method as any available today to establish synthetic validity. Because 
it focuses on tasks and requires a thorough cask analysis of a job, it 
may actually prove to have an a/dvantage in precision over other methods. 

On the other side of the task, the end result, the precise objective 
of the behavior, needs to be a contribution to the objective of the organi- 
zational activity and is ^.indeed determined by the purpose, goals, resources, 
and constraints of the work-doing system. 

The second graphic illustrating the task in the work situation is 
intended to show the level of specificity for which FJA strives. It shows 
levels of specificity in task statements beyond the functional levels at- 
tempted by FJA. It is possible to express actions as physical motions as in 
time and motion study, a minuteness that is quite desirable for engine- 
ering and physical rehabilitation purposes but quite ineffective for 
communicating ordinarily perceived work activities. Such detail would 
parallel the output specif^ '^ations used to describe the potential of 
machines and equipment. v 

Although FJA rejects this level of specificity, this chart and the 
analogous formulations that it demonstrates can be made in engineering con- 
texts. It approaches the matter of perceiving and describing work activity 
with an attempt at engineering precision. 

The Task in the System 

The more we analyzed the task from the functional standpoint, the 
more we began to understand the work situation, , We proceeded to explore 
the work situations from the standpoint of productivity and of worker 
growth. As we enlarged our vision and our experience we even dared to 
think that we had somehow captured a fundamental unit of observation 
and that perhaps we had the tiger by the tail. This is represented in 
the next graphic, which portrays the work-doing system. 

As you can see, we conceived the work-doing system as focused on 
the dual purpose of Productivity and Worker Growth. We then asked: 
What are the components that contribute to this dual purpose? The 
answer, hardly a revelation, appeared to be: The Worker, the Work 
Organization, and the Work. Did this simple formulation actually 
encompass all the significant variables of a work-doing system'? 
Suffice it to say in this limited space and time that, as I have 
elsewhere elaborated, the answer to that question is proving to be 
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"YKS'\ At any rate^ it has been a formulation of enormous power on 
the basis of which it has been possible to develop a Systems Approach 
to Miinpower Planning* As you saw a little while ago, this graphic is 
really a systems version of the graphic showing the inputs to the 
tasks* It is a sort of oak tree that grew out of the acorn, or per- 
haps a beanstalk^ that emerged from the bean. Who knows how high it 
will grow or where it shall lead* 

Already, it has led very constructively to interesting places* 
By careful analysis of the structure of each component and the 
dynamics of their interaction, we have been able to develop specific 
meta-tools for each component* For example, with regard to the 
worker, we have developed a semi-structured interview that can be 
administered as a self-report or as a face-to-face Interview. In 
both instances, we have added significant skills to the armamentarium 
of the personnel interviewer. 

With regard to the Work, we have developed a definitive tech- 
nique for job design and work flow analysis as well as the analysis 
of tasks which is basic* Here we have provided fundamental skills 
of a professional nature to the occupational analyst* 

With regard to the Work Organization, we have developed a 
system analysis approach that ties organizational analysis to work 
and worker analysis, and an organization's goals and objectives to 
a worker *s tasks* In doing so, a channel of communication is 
provided between management and the worker* 

I have described FJA as an analytic tool and as an heuristic 
device. T should like to conclude by stressing its use as a 
language of communication among the personnel most concerned with > 
the basic components of the manpower system* 

In recent years, man has discovered that the achievement of 
ordered efficiency and its introduction into life processes is not 
the answer to his problems it once seemed. On the contrary, unique 
cand disparate technologies, although clever and effective in them- 
selves and in terms of the specific problems to which they have been 
addressed, tend to find themselves in competition and often in con- 
flict with one another resulting in, something less than efficiency— 
in fact, resulting in partializing, separating, fragmenting — the 
wh(»lt> is lost in sophisticated disharmony of the parts. What has 
?pired and encouraged me about my 25 years of work' with FJA is that 
has had the reverse effect* It has brought things together. It 
brought people together. It has created an ever deeper under- 
uling of, and an ever greater organic wholeness in an approach to 
work. r commend it to you* 
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FOOTNOTES 



*S. A. Fine and W. W. Wiley, "An Introduction to Functional Job AnaXysip, 
W. E. Upjohn Institute for Employment Research » 1971* 
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GJAI: 



(To hi' completed by individual user.) 



OBJECTIVE: (jQjjg completed by individual user,) 



1 ASK. Types trnnscnbos stciiiriiird form letter, mcluding specified information from records provided, 
followiiiGS 0 P. for form lelt»M, but adjiistmg standard form as required for clarity and smoothness, 
etc., m OM^r lo piepare letter for mail:ng. 



TO DO THIS TASK 



PFRI ORVA^CESTAWDARDS 




DrrxriptivL 

• Typ' with rcd^on?lile spefnl and accuracy. 

• fcflticM ()l liMU'f IS coriput. 

• Anv LlMfurs/drijiistniorits are made correctly. 
Mtin!tMi{ ,tl 

• Co>:i;-l. IrtttT m X pt-rmd uf lime., 

• No (ii'.i Mffi'f li d ♦ :\)HiO„ nuTlidnfC?!, 

or jnl)M<;trneiU rrrois per li tt(*r. 

• Fpwit ti'dii X (M'ljss.ons of information 

per X MO. It'ttfM'; lypL'd.. 



TO THESE STANDARDS 



TRAINING CONTENT 



Functional: 

• How to type; letters. 

• How to transcribe material, correcting 

mechanical errors, 
f How to combine two written sets of data into one. 

Specific : 

• How to obtain records and find information 

in them. 

• Knowledge of S.O.P. for standard letter format: 

how/where to include information. 

• Knowledge of information required in letter. 

• How to use particular typewriter provided. 



THE WORKER NEEDS THIS TRAINING; 



Copyright; W, K, Upjohn Institute for Employment Research, June 1973 
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GRAPHIC 5 

A SySTEMS APPROACH TO MANPOWER PLANNING 
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pyright: The W. K. Upjohn Institute for Employment Research June 1973 
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THE CONCEPT OF MODULES IN MILITARY JOBS 



Robert W» Stephenson 
and 

Bertha H. Cory - Cecil D. Johnson 



A new, more specific language to describe jobs is being developed 
based upon clusters of work tasks that tend to go together occupation- 
ally and organizationally in meaningful ways. The task clusters have 
been tentatively titled "duty modules". Current research is focused 
upon testing the construct validity of duty modules based upon job 
content for potential application to personnel management, occupational 
training, and manning table preparation systems of the Army. 

Originally, job content modules were formulated for the predominant 
enlisted MOS in the Infantry Rifle Platoon, using job analysis data from 
the Army's Military Occvpational Data Bank. Since no similar basic 
source data were available for a required set of Officer MOS, specially 
designed job analyses were conducted on jobs that Infantry and Quarter- 
r..aster Officers fill. These task data were used to formulate an experi- 
mental set of officer job content modules which served as a companion to 
the enlisted job content modules. Both sets were constructed on the 
basis of occupational similarity. 

The experimental job content modules were then put to various tests 
to determine their coincidence with the clustering of tasks that occur 
in actual assignments in field units, and with the mission elements which 
are activities that are ur.ed to design and evaluate the performance of 
organizational units. 

Testi^ that has been done to date indicates that the duty modules 
that were designed appear to have some useful and valuable characteris- 
tics. 

They are designed in terms of a variety of job specialties 
rather than a single one, and show a mure definitive cross relationship 
between jobs and MOS. 

* Tl^y are designed in terms of economy in that they describe 

a position with fewer items than a task description, bat are more speci- 
fic than a generalized MOS. 

* They are readily adaptable to computer processing, EiA can 
currently use the CODAP system of task analysis. 

* They can be related to unit capability and performance at 

a level of activity common to both job classification, personnel assign- 
ment, and career management. 

Analysis in process will provide a basis for modifying and improving 
the utility of the duty modules. However, the very modularity of the 
task clusters requires that a wide number of MOS, units, and manning-table 
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duty positions be used in validating the modules* Evidence from all 
MOS and duty positions with which a duty module is concerned is needed 
before a final resolution on a specific duty module can be obtained. 



This is an abstract of Dr, Stephenson's presentation. A complete 
report on the duty module concept will be published later by the 
U.S. Army Research Institute for the Behavioral and Social Sciences 
based on work being carried on under their contract, BAHC19-71-'C-0004 
"A Taxonomic Base for Firture Management Information and Decision 
Systems'*, with the American Institutes for Research, Washington, D^C. 
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POSITION ANALYSIS QUESTIONNAIRE (PAQ)^ 
Ernest J, McCorraick 



Previously the field of occupational analysis has generally been character- 
ized by verbal descriptions of job activities and other job variables • The 
conventional essay type job descriptions certainly provide useful information 
for other purposes- however, it would be useful to have job data that have been 
more systematically collected making possible some form of "quantification" of 
relevant job information. Recently there have been a few approaches to the 
analysis of jobs somewhat more systematic and providing for such quantification. 

In this regard, we have developed what we refer to as the Position Analysis 
Questionnaire (FAQ), the intent of which was to fulfill the following objectives: 

!• To provide a generalized, structured, job analysis procedure lending 
itself to use in the analysis of a wide range of jobs. Fulfillment 
of this objective wou]^ require analysis of jobs in terms of each of 
a number of "units" of job-related data and particularly, the use of 
units that would characterize corresponding human behaviors that might 
be involved in jobs in various ..technological areas. We have referred 
to such units as "worker-oriented" job elements, as contrasted with 
"job-oriented" job elements. The worker-oriented job elements tend to 
characterize or imply the human behaviors in jobs rather than the work 
outputs of jobs, 

2. To incorporate in a basic frame of reference the analysis pro- 
cedure that is predicated on the basic "types" o^ functions character- 
ized by the psychologists as the stimulus-organ .m-respon.se paradigm 
' (S-O-R), (An organism receives stimuli from the environmi^nt , such 

stimuli operat^ag on the organism to bring about a response,. Opera- 
tionally, it was planned that : revision be made in the job analysis 
procedure for analysing i-Vc in terms of inforiiation input, mediation 
processes, and output. In addition, provision was made for analyzing 
jobs in terms of interpersonal relationships, situational variables, 
and miscei }aneous characteristics, 

3- To provide for the quantification of job-related aata by the applica- 
tion of appropriate measurement techniques and principles in the 
analysj-s process. 

Nature of the PAQ 

The PAQ used .in the research to be reported (Form A) included 189 job 
elements, each of which provided for the analysis of any given job in terms of 
"human behaviors," or that would imply such behaviors • The PAQ was organized 
into six divisions that incorporated the frame of reference mentioned above 
(ir^'-rmation input, mediation processes, and output)* These divisions are listed 
below, along with an example of a job element in each division. 
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Division of PAQ 

1. Infonnatlon Input ^ 

2. Mediation Processes 

3. Work Output 

A, Interpersonal Activities 

5*. Work Situation and Job Context 

6* Miscellaneous Aspects 
5> 



Example of Job Element 

Use of Written Materials 

Coding/ decoding 

Use of Keyboard Devices 

Interviewing 

Working In High Temperatures 
Irregular Hours 



In the analysis of jobs using PAQ, provision was made for the use, with 
any given job element, of an appropriate rating scale. Various types of scales 
were used, such as the following: 

Importance. (The Importance of the job element to the job.) 

Time. (The time for which the behavior or situation is applicable). 

Use. (The "use" of certain materials, such as sources of job Information.) 

Special codes. (These were used In the case of certain specific job elements.) 

Check items. (For certain job elements there was provision foi indicating 
whether the element did or did not apply to the job.) 

Except for the check-list scales, most of the scales were six point scales. 

Job Dimensions Based on the PAQ 

Job data based on the PAQ were subjected to a series of factor analyses in 
order to identify what are referred to as "job dlmeyislons." In these analyses, 
data for 536 jobs were used, including those from m^ny different industries, and 
representing a wide variety of jobs. One factor analysis was carried out on the 
basis of 150 of the job elements. (The job .elements not included in this analysis 
were those used Infrequently in the analysis of jobs, or used with limited reli- 
ability.) This factoi;* analysis, referred to as an "overall" factor analysis, 
resulted in the identification of the 5 Voverall" job dimensions. The other 
factor analyses were carried out with the job elements within each of the six 
divisions of the PAQ, as listed above. These factor analyses resulted in the 
identif Icatlott of 27 job dimensions. Examples of the job dimensions resulting 
from these factor analyses are: 



Division of PAQ 

1. Information Input , 

* 

2. Mediation Processes 

3. Work Output 



Example of Job Dimension 

Visual Input from Devices/Materials 
Information Processing 

Machine/process Control 
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Division of PAQ 



Example of Job Dimension 



4. Interpersonal Activities Job-related Information Exchange 

5. Work Situation and Job Context ^ Personally Demanding Situations 

6. Miscellaneous Aspects Unstructured vs. Structured Work 

Given such; job dimensions, it is possiKle to derive, statistically, a job 
dimension score (actually a factor score) tdnc each job on each of the dimensions. 
These factor scores are based on an eT^tat4xwi consisting of statistically-derived 
weights for the ratings on those particular job elements which dominantly "charac- 
terize" the job dimension in question. Thus, for any given job it is possible to 
derive a profile of job dimension scores. These job dimension scores were used 
as quantitative indexes of jobs in connection with two experimental applications 
of PAQ data. One of these applications was in the framework of estimating the 
aptitude requirements of jobs, and the other in the framework of estimating compen 
sation rates for jobs. 

Use of PAQ Dat^ for Job Component Validity ' 

One of the possible applications of- PAQ data about jobs is in the context 
of job componer.t validity (what has commonly been referred to as synthetic 
validity). In general terms, this concept is predicted upon the assumption 
that Jobs involving tne same basic "human behavior" require -^the same basic hu- 
man at tribute (s) - in so far as that particular human behavior ij concerned. 
In the case of data from the PAQ, it is hypothesized v^^iat jobs comparable in 
terms of job dimension scores on a given job ' dimension presumably require es- 
sentially the same human at tribute (s) for successful perfldnnance of .such behav- 
ior. If the level of the human attribute required for performance of some 
basic type of human behavior can be determined with reasonable statistical con- 
fidence » it would t^en be possible to apply such findings to other jobs. Thus, 
the basic tiame of ret^irence of the job component validity concept is the attri- 
bute requirements of yjhs might be derived statistically on the basis of "common 
denominators" of jobs without need for conventional test validation procjdures 
in the case of each and everv iob« 

In exploring the possible use of PAQ data for the purpose of establishing 
the job component validity of jobs the mean test ticores on each of 9 tests of 
the General Aptitude Test Battery (GATB) of the United States Training and 
Employment Service for 90 j^bs were used. These mean test scores were used as 
indications of the relative "importance" of the attributes measured by the 
individual tests to succe?<?ful performance of the jobs, on the assumption that 
the individuals have te;ided to grativate into jobs that are commensurate with 
their o^ abilities. Thus, for any given test, it would be assumed that the 
jobs whose incumbents have high mean test scores on that test requlrerjnore of 
the quality measured by the test than those jobs whose incumbents hav low mean 
test scores. 

PAQ's for 179 jobs corresponded with these^ 90 jobs for which GATE test 
scores were available. »^ (in certain instances PAQ's were available ^or 2 or more 
jobs that corresponded with 1 of the 90 jobs.) 
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The job dimension scores of tAe 179 jobs were used as "predictors" of 
mean test scores of incumbents on the corresponding 90 jobs, separate 
analyses being carried out for each of the 9 tests for which test scores or 
incumbents were available. By use of a regression analysis, it was possible 
to identify statistically a combination of job dimension scores that gave the 
optimum degree of correlation with the mean test scores of job incumbents. 
The multiple correlations resulting from this analysis are listed below for 
the 9 tests. 



GATB Test 



Multiple Correlation 



G - 


Intelligence 


.78 


V . 


Verbal 


.80 


N - 


Numerical 


.75 


S - 


Spatial 


.70 


P - 


Form perception 


.62 


Q - 


Clerical perception 


.73 


K - 


Motor coordination 


.71 


F - 


Finger dexterity 


.64 


M - 


Manual dexterity 


.59 



These correlations range from .59 to .80 with a median of .70. The magni^ ' 
, tude of these correlations strongly suggests it would be possible to estimate the 
aptitude requirements of jobs on the basis of quantitative data from the PAQ, 
without need for conventional test validation. 

Estimation of Compensation R ^tes lor Jobs Based on the PAQ 

In connection with establishment of compensation rates of jobs, one might 
hypothesize such rates should be comparable for jobs with similar requirements 
as far as human behaviors are concerned. The bas^c approach to application of 
PAQ data in this frame of reference was comparable to that used in the job com- 
ponent validity phase mentioned above. In this instance, however, the "criterion'' 
used was the monthly wage or salary rate for each job included in the analysis. 
A sample of 340 jobs from a variety of industries and different parts of the 
country was used in this phase. The job dimension scores for these jobs were 
used as predictors of their monthly rates of compensation. A cro^s-validation 
procedure' was used which involved dividing the total sample into two sub-samples, 
and deriving, by regression analysis, the combination of job dimension scores 
that best predicted the going rates within the sample. T^ie resulting equation 
derived for one sample (subsample A or B) was then appli^ed to the other sample 
(subsample B or A respectively). The estimated compensation rates so derived 
were then correlated with actual rates of pay in the sample in question. ' 



Multiple Correlation 
Initial sample 



Cross-Validation Correlation 
Other sample 



A 
B 

A & B 



.87 
.90 
.87 



B 
A 



.85 
.83 
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The correlations generally were in the m^d- to upper-eighties. In a 
couple of specific situations estimated compensation rates (based on the results 
oi analyses of these 340 jobs), as applied to jobs in each of two organizations, 
resulted in correlations with actual rates of pay for jobs in those organizations 
of .93 and .94. 

Discussion 

On the basis of data derived from the study, it seems evident the use 
of a structured type of job analysis procedure, such as the PAQ, can serve as 
the basis for quantifying jobs in a manner that may serve certain practical 
objectives. In turn, it appears to be within the realm of possibility to use 
data so generated as the basis for establishing aptitude requirements for jobs 
and deriving indexes of job values that can be used directly for getting com-- 
pensation rates. To the extent these objectives could be fulfilled it would 
then be possible to eliminate the usual test validation and job evaluation 
procedures otherwise required. 

<■ 

Application of PAQ to Naval Billets 

The PAQ was used in the analysis of a sample of naval billets as the 
basis for comparison of compensation rates for naval personnel related to the 
compensation rate? that would be applicable to civilian jobs with corresponding 
job characteristics. The sample included 617 billets of enlisted personnel 
aboard three aircraft carriers and in 6 air squadrons, and t!!he billets of 
249 officers at that time attended the Naval Postgraduate School or attached 
to the Naval Safety Cencer. In the case of the officer billets. ,/ the officers 
themselves used the PAQ as the basis for describing the bi^llet held oti their 
previous assignment. / o 



As the basis for the estimation of compensation rat/es for naval personnel, 
three sets of assumptions were made, varying in the assumed **status" of the 
individiial, including his dependency status and his "it^tent** to remain in the 
service (which would, of course, influence the estimated financial benefits in 
the form of retirement pay). In general terms, these assumptions provided a 
••high" and "low" value for each hypothetical incumbent, and might thus reflect 
the "range" of financial benefits that could be characteristic of incumbents 
of any given rate or rank. 

On the basis of the PAQ analyses of the billets, a compensation rate 
estimate for civilian jobs with corresponding characteristics was *derived, 
based on data from a fairly large sample of civilian jobs that had been analyzed 
with the PAQ. These values were adjusted t9 reflect average increments in 
earnings since the original data were obtained for the civilian jobs. 



The comparisons were made on two basons; namely, the estimate of the 
direct or "take home" pay (including 'certain specific money equivalents) and 
total compensation (incJuding all possible forms of fringe benefits, as might 
be applicable to both naval and civilian jobs). 
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Results of these comparisons are shown in Figures 1 and 2. Note that com- 
parisons in the case of certain ranks are based on very small tubers of 
cases; and thus should be discounted. 

By and large, these comparisons point up the fact that the actual com- 
pensation for incumbents of naval billets tends to be lower than that for 
incumbents of civilian jobs having similar characteristics. 
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FOOTNOTES 

''This paper is based isx large part on the following:' 

McCormick, E.J., Jeanneret, P.R. , & Mecham, R.C. A study of job 
characteristics and job dimensions as based on the Position 
Analysis Questionnaire (FAQ). Journal of Applied PsycholoRy , 
1972. 56 (4), 347-368. 
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CAREER DEVELOPMENT SESSION 
INTRODUCTOKY REMARKS 



Edwin A* Fleishman 



The general area of research on careers is quite an active one 
;it present, covering a variety of facets. The t^avy's interest in 
this field, as a research domain, was until recently primarily di- 
rected at problems of personnel retention in the Navy^ A great 
deal of effort was expended on identifying what factors lead to 
retention of Navy personnel after the firsJt or subsequent enlistments, 
with a view to translating these findings into policies and proce- 
iires for getting personnel to re-enlist. 

The new emphasis on problems facing the Navy as a result of the 
all volunteer defense forces and zero draft have forced us into a 
more sophisticated and differentiated look at the Navy's career 
motivation and development problems. Consequently, it is timely 
that we examine what is happening in research on various aspects of 
this problem in other sectors as well as in the Navy. 

Ar> I reviewed this general area of work, to prepare this session 
of the program, 1 thought about the areas that ought to be represented. 
There appeared to be a number of people with models, with various ones 
in different stages of development and with different amounts of data 
to support such models. These models had been applied in different 
contexts — educational, managerial, industrial, military and the like. 

Some research has been mainly descriptive, emphasizing what 
happens as occupational choices are made at different points in 
raret-r pr ogression . Other research has been interested in the moti- 
vat ional aspects of careers. In this work, interest is in the needs 
and incentives which bring an individual into a career field. Why 
does he choose a given field or why does he stay in it? What are the 
motivational factors that energize and channel individual behavior in 
a given career progression? 

The topic of s ocialization is another Increasingly investigated 
one in this area. Once in a career field, or in an organizational 
Slotting, what are the factors in the individual's eitVironment and 
life space which sh< pe his choices? Another rela«-ed focus in this 
area is centered on the process of decision-making . What is the 
de< is ion-making process that individuals engage in at various stages 
of their life and work histories? 

Then, there are the active areas of research on career counseling 
and occupational infor mation systems . These may be institutional 
(such as systems in business, education, and military contexts) and 
in(li>/idual (such as that involved in the individual counseling setting) 
And, finally; there is the increasing concern between individual and 
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organizational needs and values and the interaction between them as 
a basis for understanding and predicting the career development 
^process. 

c 

In selecting our participants I have tried to keep these aspects 
of the proBTem in mind. We are fortunate in having some of the leading 
researchers in the country now working in these areas. Our format is 
to begin with some general theoretical and conceptual developments and 
their application. We will then move to some specific methodological 
developments and specific problem applications, closing with recent 
work on specific Navy career motivation questions. 

V 

Specifically, Dr. Walsh will deal with Holland's theory of 
occupational choice and, in particu?.ar, with the concept of congruence 
which has proven useful in this area. Dr. Tiedeman will describe a 
system for decision*making at various critical points during an 
individual's career, with emphasis on computer applications in the 
counseling process where occupational information can be p>ore effec- 
tively applied to the individual's needs. Dr. Korjian will deal with 
. the individual once he is in a career pattern and will focus on 
changes in career patterns and the conditions under which people 
continue to grow or decline in their career achievements. Dr. England 
will describe his work on the value syst^as of managers and adminisrators 
with emphasis on the measurement of values. His interest, in part, has 
been on ways careers influence values and how values influence careers. 

Finally, Dr. Glickman will describe some recent model development 
and research on career motivation in the Navy context. 
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HOLLAND'S THEORY AND THE CONCEPT OF CONGRUENCE 



U. Bruce Walsh 



liolland, reg/?i:ding interests and vocational preferences as expressions 
of personality, <ievelopea a theory of careers (Holland, 1973). In his theory 
Holland makes three assumptions based on the notion that vocational behavior 
is a<^unction of the interaction between the person and the environment. 
The first assumption is that people may be characterized by their resemblance 
to one or more personality types (the Realistic type, the Investigative type, 
the Social type, the Conventional type, the Enterprising type, and the 
Artistic type). In general people possess characteristics of all 6 types, 
but Holland suggests that each individual behaves in a manner which reflects 
one or two of these orientations more strongly than others. Therefore, the 
closer an individual resembles a type, the more likely it is he will exhibit 
personal characteristics and behavior consistent with that type. To opera- 
tlonalize the six personality types Holland developed the Vocational 
Preference Inventory (Holland, 1965) and more recently the Self Directed 
Search ^Holland, 1972). 

A second assumption is that the environments in which people live may 
be characterized by their resemblance to one or more same named model environ- 
ments. For each type there i^s a related environment (Realistic, Investigative, 
Social, Conventional, Enterprising, and Artistic). The theory hypothesizes 
that Investigative types wiljl seek out and enter Investigative occupations 
(environments) and that ArtiBtic types will select Artistic occupations 
(environments). Existing evidence does indicate that individuals tend to 
choose college major environments and occupational environments consistent 
with their personal orientations (Holland, 1962, 1968; Lacey, 1971; Lopez, 
1962; Osipow, 1970; Osipow, Ashby, and Wall, 1966; Gaffey and Walsh> submitted). 

The third assumption is that congruent person-environment interactions 
(a Realistic personality type in a Realistic environment) lead to outcomes 
that are predictable and understandable from the knowledge of the person- 
ality types and the environmental models. The outcomes include vocational 
choice, vocational stability and achievement, personal stability, and 
satisfaction. Thus, Holland's Theory suggests that congruent person- 
environment relations are conducive to stability, achievement, and satis- 
faction. It is primarily this suggestion (hypothesis) that our work has ex- 
plored through a number of studies, five of which I will discuss today. 

The first study (with Russel, 1969) explored the differences reported 
in personal adjustment problaEos between freshmen students (male and female) 
who made a congruent college major choice and students who made an incon- 
grucnt choice. The prediction was that individuals reporting congruent 
person-environment relations would tend to report fewer personal adjustment 
problems when compared to the incongrucnt groups. 
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The congruent and incongruent choice groups were defined, according to 
Holland's theory. This definition of congruence used reported college major 
choice to define the environment and the Vocational Preference Inventory to 
define the student. A congruent college irajor choice was one that was con- 
sistent with the student's primary personality type (highest scale score) 
as operationally defined by the Vocational Preference Inventory. For 
example, a student reporting a college major choice (accounting) consistent 
with his peak score (Conventional) on the VPI was labeled congruent (identical 
one-letter codes). Thus, congruence was defined as consistence between what 
the student is doing (college major) and what the inventory (VPI) suggests 
he might be doing. An incongruent college major choice (music) was one 
that was not consistent with the primary personality type (Realistic) of 
the student. 

A word more about the Vocational Preference Inventory does seem appro- 
priate at this point. To operationalize his 6 personality types Holland 
.developed the VPI (a personality inventory composed of occupational titles). 
Holland reasoned that preferences are related to personality, and preferences 
are related to interests. Therefore, interest must be related to person- 
ality; hence, interest inventories are personality inventories. Thus, the \ 
basic idea behind the VPI (which is composed of 160 occupational titles) is 
that preferences for occupations are expressions of personality. If an 
individual prefers a large number of occupations associated with a person- 
ality orientation this tells us something about his coping behavior and his 
dominant personality style. In general, the results of the validity studies 
(concurrent and predictive) lend support to the meaning attributed to the 
scales (Realistic, Investigative, Social, Conventional, Enterprising, and 
Artistic). Test-retest reliability coefficients are adequate. 

In the first study with Russell personal adjustment was defined 
operationally with the Mooney Problan Checklist (Mooney and Gordon, 1950). 
The MPC was constructed to aid students in expressing their personal problems. 
To respond a student underlines problems which trouble him. The total number 
of reported problems was the score obtained for each student. No reliability 
and validity coefficients are reported for the MPC. The author believes the 
reliability and validity coefficients would be subject to error because of 
the change that takes place in the individual and the way he perceives his 
problems . 

The sample for the study consisted of 65 third quarter freshmen female 
students and 59 third quarter freshmen male students in the Ohio State 
University residence halls. These students made up 4 groups — male and 
female congruent and male and female incongruent. 



Sex 



Male 



Female 



Congruent 



N ^ 20 



N - 30 



Congruence 



Incongruent 



N « 39 



N = 35 
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Three hypotheses were tested by means of analysis of variance for 
unequal numbers for the adjustment scores (1, the congruence hypothesis, 2, 
the sex hypothesis, and 3, the Interaction between congruence and sex 
hypothesis). We were most Interested in the congruence hypothesis. ^ he 
findings revealed that students who made a congruent college major choice 
reported fewer personal adjustment problems than students who made" an 
incongruent choice. This finding was significant fpr males and approached 
significance for females. The results are consistent with Holland's notion 
that congruent person-environment interactions are conducive to better 
maintenance of personal stability. 

The second study (with Lewis, 1972) explored differences on personality 
variables between freshmen students who made congruent, Incongruent, and 
this time we added an undecided group. Our thinking was that individuals 
reporting congruent person-environment relations would tend to be more 
personally stable when compared to the incongruent and the undecided groups. 

The congruent and Incongruent college major choice groups were opera- 
tionally defined as in the previous study. The congruent groups were 
composed of students who reported a college major choice consistent with 
their primary personality type determined by the VPI. The incongrueriit 
groups were composed of students who reported a major inconsistent with 
their primary personality type. The undecided groups consisted of students 
who reported no major or Indicated an undecided status. 

The personality variables were operationally defined by the Omnibus 
Personality Inventory (Heist and Yonge, 1968). This we thought would be a 
more rigorous definition of personality than the Mooney Problem Checklist 
used in the previous study. The DPI is a personality inventory for "normal" 
students composed of 385 items. It consists of 14 scales designed to 
measure normal ego functioning and intellectual activity. Reliability 
coefficients (test-retest) range from .84 to .93 for college males. The 
time Intervals between the two test administrations range between three and 
four weeks. The scales show evidence of concurrent and predictive validity. 



Male Female 



Congruent 

Congruence Inrongruent 
Undecided 



N = 


37 


N = 


37 


N = 


37 


N = 


37 


N = 


33 


N = 


33 



The sample consisted of 214 male and female undergraduates (second 
quarter freshmen) from the General Psychology class. There were six groups- 
male and female congruent, male and female incongruent, and male and female 
undecided. 
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Again, three hypotheses were tested by means of analysis of variance 
f^r unequal numbers for each of the 14 personality variables (1, the con- 
gruence hypothesis, 2, the sex hypothesis, and 3, the interaction hypothesis,) 

The results showed the test for the main effect of congruence to be 
significant (p<,05, ,01) for four personality variables (Impulse Expression, 
Personal Integration, Anxiety Level, and iiesponse Bias)* In general, the 
findings suggested that congruent males reported being socially accepted, 
logical, analytical, in a state of well being, less anxious, and less 
impulsive than the other groups (particularly the undecided and incon- 
gruent male groups) • The undecided males reported feeling socially alienated, 
tense, impulsive, imaginative, and distrustful in their relations with others. 
The incongruent males reported feelings of isolation, loneliness, and im- 
pulsivity* Thus, for congruent males the results tend to be consistent with 
llollauJ s Ttcrtii:on-i:hat--emtgifiient person-environment relations are conducive to 
better maintenance of personal stability. Indirectly the findings further 
suggest that che congruent males tend to be more personally satisfied than 
the members of the other groups. 

The thitd study with Osipow, (in press Journal of Research in Higher 
Education) was identical in design to the second study (Walsh and Lewis, 
1972). This study explored differences on self-concept and vocational 
maturity variables between freshmen students who made congruent, incon- 
gruent, and undecided college major choices. The congruent, incongruent, 
and the undecided groups were defined as before. 

The self-concept variables were defined by the Tennessee Self-Concept 
Scales (Fitts, 1965) which is composed of 100 items that the student uses 
to describe his picture of himself. The Tennessee consists of 27 scales, 
14 of which were used in this study. Test-retest reliability coefficients 
for a sample of collge students over a two week period are generally in 
the 70's and 80' s» The scales show evidence of validity. 

The vocational maturity variable was operationally defined using two 
instruments the Career Questionnaire, Form IV (Super, Bohn, Forrest, 
Jordaan, Lindeman, and Thompson, 1971) and the Vocational Development 
Inventory (Crites, 1965) ♦ 

The Career Questionnaire is designed to measure vocational decision 
making skills. It is composed of 93 items that the student uses to report 
his career thoughts and plans. The scoring procedure yields four such scores 
(Planning Orientation, Resources for Exploration, Information and Decision- 
making, and a Total Score). No estimates of reliability and validity are 
available at this time. 

The Vocational Development Inventory is designed to measure beliefs 
and attitudes about career planning. The VDI is composed of two scales 
(Vocational Maturity and Vocational Deviation). Evidence suggests that the 
Vocational Maturity scale is reliable (test-retest) and valid. 
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The sample was composed of 162 male and female undergraduates (second 
quarter £reshmen) from the General Psychology class. There were six groups — 
male ai female congruent, male and female incongruent, and male 
and female undecided. 

Sex 



Male Female 





Congruent 


N = 


27 


N = 


27 


Congruence 


Incongruent 


N = 


27 


N = 






Undecided 


N = 


27 


N = 


27 



Three hypdlheses were again tested using analysis of variance for 
equal numbers for eich of the self-concept and vocational maturity variables. 
The test for the main effect of congruence was found to be significant 
(p<.05, ,01) for three variables of the Career Questionnaire (Planning 
Orientation, Information and Decision Making, and Total Score) and for the 
Vocational Maturity scale of the Vocational Development Inventory. However 
none of the self-concept variables were found to be significant. 

T lese findings suggested that congruent males and females tend to 
report more specificity in occupational planning and implementation of 
preferences through major field choice than the other groups (particularly 
the undecided male and female groups). Futhermore, the congruent male and 
female groups reported more knowledge and application of decision making 
skills and awareness of sources of occupational information. Thus, the 
congruent malef; and females seem to have a more stable college major choice. 
In essence, the evidence suggests that congruent person-environment relations 
are associated with vocational stability and maturity. 

In sum the previous three studies suggest that congruent people (con- 
gruent person- environment relations) tend to have better maintenance of \ 
personal and vocational stability, more stable college major choice^, and 
moro vocational maturity than the incongruent and undecided people. 

The next two studies are similar in design to the previous studies, 
but they are different: 1, thes^ studies operationally defined the person- 
ality types and the concept of congruence using Holland's recently developed 
instrument, the Self-Directed Search; 2, one of these studies introduced the 
notion of levels of congruence; 3, one of these studies used an older sample 
of students. 

Thus, the next study (4th) (with Howard, O'Brien, Santa-Maria, and . 
Edmondson in press Journal of Vocational Behavior) explored differences on 
variables of satisfaction between freshmen who made congruent and incon- 
gruent college major choices. 
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The congruent and the incongruent. groups were defined using the Self- 
Directed Search. In this definition of congruence current occupational 
choice was used to define environment instead of college major choice and 
the felf-Directed Search was used to define the personality type (student) 
instead of the VPI. Thus, a student whose current occupational choice 
(physician) was classified as Investigative (ISA) according to the SDS 
Occupation's Finder (Holland, 1970) and whose first letter in his SDS 
summary code (IRA) was I (Investigative) was called coigruent. ThuF, 
congruence was defined as consistence between what the student would like 
to d^ vocationally and what the inventory suggests he might do vocationally. 
The inccngruent current occupational choice groups were composed of, students 
who reported a job choice inconsistent with their primary personality type. 
For example, a student whose current job choice (accountant) was classified 
as Conventional (CES) and whose first letter in his summary code ESC was 
E (Enterprising) was called incongruent. 

A brief description of the Self Directed Search may be helpful here. 
The SDS is a simulation of the vocational experience. The student indepen- 
dently (on his own) takes the inventory, scores it, profiles the results, 
and reviews an occupational file (the Occupations Finder) for occupational 
alternatives. Separate sections for Activities, Competencies, Occupations 
and Self-Ratings determine a person's resemblance to each type. Students 
are also asked to list their occupational daydreams (current occupational 
choices). The SDS yields a three letter summary code in which the three 
highest total scores are ranked in order. Two recent studies (O'Connell 
and Sed.^acek, X971; Zener and Schnuelle, 1972) show that the three letter 
codes are reliable. Holland would say that then construct and predictive 
validity of the scales and items are contained in the theoretical studies 
which stimulated the development of the instrument. 

Satisfaction was operationally defined using the College Student Satis- 
faction Questionnaire, Form C (Starr, Betz, and Menne, 1971). On this 
instrument students are asked to report their thoughts about various 
aspects of their college. The questionnaire yields five scale scores and 
a Total Score. It is a reliable and valid measure. 

The sample was composed of 140 male and female undergraduates (second 
quarter freshmen) from the General Psychology class.. There were 4 groups — 
male and female congruent and. male and female incongruent. 



Congruence 







Sex 




Male 


Female 


Congruent 


N = 35 


N = 35 


Incongruent 


N = 35 


N = 35 



Three hypotheses were tested using analysis of variance for equal 
numbers for each of the satisfaction variables. However, in the test for 
the main effect of congruence none of the satisfaction variables were found 
to be significant. 
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•Since none of the satisfaction variables were found to be significant, 
wc did something we had not previously planned on. In order to increase 
group disLriminatory power congruence was defined more rigorously. Con- 
gruence was defined as agreement between first and second letters of the 
current occupational choice code .nd first and second letters (same order) 
of the SDS summary code. For example, a student whose current Job choice 
(physician) was classified as Invest iga^t tve - Social (ISA) according to 
Lho SDS Occupations Finder and whose first and second letters of his SDS 
summary code (ISE were IS (Investigative - Social) was called congruent. 
The redefinition did reduce th? sair.ple size of each group. 



Sex 







Male 


Female 




Congruent 


N - 16 


N = 29 


Congruence^ 










Incongruent 


N= 29 


N = 29 



m«'i 



Now the same three hypotheses were tested. This time the test for the 
i. effect of congruence was found to be significant (p ^ .05) for four of 
the CSSQ scales (Working Conditions, Recognition, Quality of Education, and 
Total Satisfaction). On each of the scales the congruent male group had 
the highest mean score. The findings revealed that the congruent males 
reported more satisfaction with the physical condition of the college, with 
the accepting attitudes of faculty and students, and with the academic 
conditions associated with intellectual and vocational developaent than the 
incongruent females. 

In summary, for congruent males (using the more rigorous definition of . 
congruence) the results of this study are consistent with Holland's- notion 
that congruent person-environment relations are conducive to greater satis- 
faction. The findings also suggest that there may be different levels of 
congruence such as three-letters identical, two-letters identical, one- 
letter identical, and no letters identical. 

The fifth and final study (Walsh, in press Journal of Vocational 
Behavior) again explored differences on pr rsonality variables between 
upperclass students (not freshmen) who mace congruent and incongruent 
Occupational choices. The congruent and incongruent groups were defined 
as before (identical one-letter codes) using the SDS and current occupational 
choice. 

The personality variables were defined by the Omnibus Personality 
Inventory (Heist and Yonge, 1968) and the California Psychological Inventory 
(Cough, 1957). Both are reliable and valid measures of personality. The 
OPl consists of 14 scales designed to measure ego lunctionlng and ir»*:el- 
lectual activity. The CPI consists of 18 scales designed to measure 
characteristics important for social Interaction. 
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The sample was small— 59 males and females primarily upperclass students 
(4 sophomores, 24 juniors, 24 seniors, and 7 gruauate students). There were 
again four groups—nale and female congruent and male and female incongruent. 

Sex 

Male Female 

Congruent 

Cong; aence 

Incongruent 



The findings showed the test for the main effect of congruence to be 
significant (p 0.05, ,01) for eight variables of the CP I (Dominance, 
Capacity for Status, Well-being, Responsibility, Sell-control, Tolerance, 
Achievement via Conformance, and Intellectual Efficiency) and one variable 
(Personal^ Integration) of the OPI, 

The findings showed that congruent males reported being more socially 
accepted, ambitious, planful, energetic, productive, valued intellectual ' 
achievement and work than the incongruent male and female groups. The 
incongruent males reported being self-conl^ident, aggressive, impulsive, 
insecure, lonely, unambitious, and pessimistic about their occupational 
futures. The incongruent females tended to be retiring, conventlonaf, 
insecure, lonely, restricted in interests, unambitious, and pessimistic 
about their occupation futures. 

Thus, again these two studies' using the SDS to operationalize the 
personality types and the concept of congruence suggest that the congruent 
people (particularly congruent mal^s) tend to report more satisfaction and 
better maintenance of personal and vocation stability. 

The applied tentative implication of this research is that students 
who have selected and are functioning in a college major (envirotuaent) 
consistent with their personal characteristics seem to be psychologicaUy 
healthier than students who have selected a college major somewhat incon- 
sistent with their personal characteristics or students who remain undecided. 
This implies that a realistic decision about college major choice early in 
the college years may contribute to psychological health and well-being 
for some of the personality types. 

In terms of research implications, clearly the concept of congruence 
needs to be extended to the world of work. The need exisii^; to explore dif- 
ferences (personality, vocational stability, satisfaction, and performance) 
between people who have entered congruent occupational environments, people 
who have entered incongruent occupational environments, and people who have 
entered no occupational environment. We hope this will be our next research 
task. 



N « 14 
N » 21 



N « 11 



N - 13 
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A SYSTEM FOR DECISION-MAKING DEVELOPMENT DURING CAREER DEVELOPMENT 

2 

David V. Tledeman" 

and ^ 
Anna Mlller-Tiedeman 

Differentiating Career Choices 

About two decades ago Dr. Denzel D. Smith was good enough to 
sponsor, through the Office of Naval Research, a series of studies of 
vocational development in which Tiedetnan was engaged. Prior to that 
sponsorship, Tiedanan*s colleague Dr. Joseph G.Bryan (1950) had defined 
and solved the multiple discriminant function problem. Professor Phillip 

Rulon and Tiedeman subsequently joined Dr. Bryan in exploring app- 
lications of multiple discriminant analysis. Rulon largely engaged in 
further methodological application (Rulon, Tiedeman, Tatsuoka, and Langmuir, 
1967); Tiedeman mostly engaged in using multiple discriminant analysis 
in the study of vocational development. 

Tiedeman' s initial applications of multiple discriminant analysis 
was in the study of educational and vocational choices. A series of 
studies which he loosely bound together under the umbrella. Harvard 
Studies of Career Development (see Tiedeman and O'Hara, 1963, Section 
V, for history) began to indicate not alone the obvious fact thpt people 
who pursued one or another educational or occupational endeavor differed 
significantly at entries but also indicated the discriminatory canon- 
ical variation associated with that separation. 

Tiedeman remained interested in describing the discriminating 
canonical variation but until recently left such descriptions to others. 
Roe's (1956) theory of occupational choice and Holland's (1959) 
theory of vocational choice in general dominate vocatidhfiil psychology 
at the present time. Both theories essentially presume interaction of 
being and doing. A person is presumed .both to be what he does and to 
do wfiat he is. In these theories action is presumed to satisfy need. 
Our experience has also indicated that action engenders need as well. 
Roe (1957) has reverted to child rearing practices in search for 
origins of occupational needs. Holland (1966) relies on personality 
manifestations. 

Project TALENT which Tiedeman directed from July 1971 until 
his resignation in August 1973 has the most convincing empirical data 
on differential origins of educational and occupational 'choices. 
Cooley and Lohnes (1968) describe the discriminating variance of the 109 
high school antecedents of TALENT's subjects classified according to their 
career category five years after expected year of graduation. Cooley 
and Lohnes also began derivation of a career tree since the probabilistic 
nature of TALENT's stratified sampling of about fi\re percent of America's 
1960 high schools permits estimation of branching probabilities. Cooley 
and Lohnes' initial study of TALENT*- five year career data was corroborated 
in study and report of another grade of data by Flanagan, Shaycoft, 
Richards, and Claudy (1971), In this study Flanagan (Flanagan et al. , 



m 

100 



II-3.1 



1971, Ch* 6) also derived twelve groups of occupations which are logically 
and empirically homogeneous within groups but different from one group 
to another* Two lines of work are presently underway on the Flanagan 
career groups. In one instance, the ^career groups are being used as basis 
for report in a forthcoming Career Data Book (Flanagan, Tiedenan, 
and Willis, 1973) of the differentiated occupational profiles of TALENT* s 
subjects. In the second instance, the stabilities of career choices 
one, five, and eleven years following expected year of graduation are 
being contrasted using the Roe, Holland, and Flanagan occupational 
classification system. 

The Self Concept and Career Choice 

Until 1971 Tiedeman had largely left description of dis- 
criminating occupational variability to others. Tied^aan did so 
because initial studies vrith his colleagues (e.g. Cass and Tiedeman, 
1960) suggested that personality and interests generally dominated 
ability variables in discriminating educational and occupational groups. 
This result had the ring of reasonableness once known. Investment of 
one's time in educational and occupational worlc probably ought to be a 
more defini::e function of inclination or desire than of ability. There 
is hope that ability and activity conform but the person is probably 
much more likely to opt first for satisfaction of basic needs than for 
satisfaction of effectance needs. Persons have much more confidence 
than observers in their capacity to surmount the difficult. In many 
instances persons show up observers* doubts because learning while 
acting does occur. 

The above- observations led Tiedeman in the early 1950' s to 
self concept as a potentially directing. condition In occupational 
choice. Super (1953)had at about that time given the self concept central 
place in vocational development. Robert O'Hara joined Tiedenan first 
as a student and later as colleague in elaborating operation of the self 
concept in vocational development. O'Hara (1957) first logically dif- 
ferentiated the vocational area from Carl Roger^s general theory of 
self concept development. He next operationalized vocational self 
ronceptions and with Tiedeman (O'Hara and Tiedeman, 1959) published a paper 
on the possible developmental differentiation of vocational abilities, 
interests, and values during secondary school. Interestingly enough, 
O'Ha'ra's initial formulations have so far withstood time pretty well. 
O'Hara has himself continued to find that self conceptions add to the 
variance of predicated educational success. Tiemey and Herman are 
just publishing (1973) a verification study of O'Hara's and Tiedeman's 
developmental results. Their study does call one of O'Hara's and Tiedeman's 
earlier developmental conclusions into question once again. However, 
for the most part by omitting a ninth grade sample which O'Hara and 
Tiedeman had they lacked capacity to fully test the earlier results. 

Self Concept and Career Development 

In 1961-63, the College Entrance Examination Board gave 
Tiedeman and several others the opportunity to have an informal seminar 
on career development theory with expectation that several monographs 
on the subject would be published in order to point ♦:he way to further 
research. Professors Jean Jordaan and Donald Super published their 
essays from that seminar under title Self Concept Theory (Super, Starish- 
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ev.sky, Mathin, and Jordaan, 1963). OMiara and Tiedeiuan published their 
essays as Career Development; Choice and Adjustment (1963). 



In the Tiedeman and O'Hara essays, O'Hara and Tiedeman largely 
adapted Kr ikson's (1959) conception of ego- identity to vocational develop- 
ment. o'Hara largely differentiated vocational identity within ego- 
identity using Erikson's eight stages. As he had done earlier, Tiedeman 
(1961) largely first adapted Super's life-developmental framework of 
career stages to the case of a single decision in career choice and 
then proposed that career development took place within the uniot of 
career choices within the several career decisions constituting career 
development in their totality. Thus Tiedeman in effect proposed that th^ 
micro stages of a single career decision unite throughout the life into 
the macro stages of career development. An analogue could be the layers 
of an onion: each onion layer constitutes a ring; the rings in their 
totality constitute the onion. 

itiiititit 

Tiedeman and O'Hara (1963) mploy(ld tlid togid 0^ 
decision making to pfiopo^z a tingtiutic 
({tamcwo^fe loct/ioi i^ick compn,dieji6lon 
dtcLsion making meJige^ dafUng incxdmts 

aviZQA dioicz. E^6entlaJ[Jty, thoAA 
^xamemxk ^Oi6t dtvidti tlit pftoce^s 
dcci&ion making into tnKf oApectA, 
anticipaXion and accommodation. Tkz 
anticipa^tion aspect coH4^4ti e4^e>t£- 
iatty 0^ a pmon's preoccupation loc^/i 
the pizcu (/JactA, attojoyitivu ^ options, 
co>L5eqacJtce4) oat o(^ voliixih a decision 
i& to be ia^liioneA and voiXh the a^pi/i- 
ationA, hopeA, CKpccXation6 , conAtn/ii^tt6, 
and the tike i^tich uoiZt doXenmine tiie 
{^ofvm 0^ the decision, rhe accotmo- 
doJjjon aspect ^ep^e6citt6 the movement 
ij^om anticipation to induction; it i^ 
the point vdioAe imaghiation meeth 
xeatity. In tiie case of^ both anti- 
cipation and accommodation, it i>s 
pot^6ibte to 6peak abou^t "subaspects" 
on. stages. 

Anticipation 

The i(<A6t stage o(^ anticipation catled 
exptonation bujgins cuct/i a pexson^s 
amxenoJSiS "t/iaf a pxobtesn does ok 
mtZ exist and tixat a dexiision must 
be reached in ondoA to n^esotve it in 
a i^aXxs^ybig manncA" (p. 3S). In 
di!>cussing exptonation, Tiedeman and 
O'HoAa state: 

***** 

The part of this paper that is set off in SCAtpt has been approved 
for publication by Love Publishing Company, November 8, 1973. 
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"In th(L 6ttp 0(5 Qxplonation. • . 

ofi po6/^ibt^ goaZ6, ♦ .my be con- 

iA)kidi am poz^ibty be attained ^nom 
the, oppontanltiu a660(Ujated mXh 
tlfiz fyiobtm uundvL coMldQAatlon. , 

• • VivUng thz oxptonjat/ofiy 6tzp, 
iloXxU o^e KeJtatAvzty tMMlto^, 
highly imgina/iy [pvihoLjp^ even, 
iajntmtic), and not noxiQ/^i^anAJiy 
n,ttated onz to tkz othvi. Thzy 

way be a^eZativeZy una660CAjated 6tt 
oi po66ibiJUtiu and can6e({aence&, • 

• . In >tfie 6tzp 0^ exploitation 

in fiztation to a problem oi ca/teeA 
development, a peA&on pftobably 
/tejJ-tectA at le/ut upon hi^ oApina- 
tion, opportunity hotii note and ijn 
the iutuJie, intejvut, capability, . 
di&ta&teiul reJiuiAemejfvU that 6tilZ 
can be toleAated, and societal 
context ion. kimeli and hi& depen- 
dents, TheMe axe neZevant aspects 
oi the iieJtd set by each goal. In 
shoAt, eocft otte/tnatcue 06 he senses 
U {pp. 3S & 41)-" ' 

Oi CAif^talZization, the second stage 
oi anticipation, they asse/tt^ 

"In [cAystalLLzation] the cost o^ 
the seveAol goals can be con- 
sideAed in relation to the 
netuAn ^om each. The value 
oi alteAnatives can then be 
assessed. Relevant consideAa- 
tions in nelatijon to each o^ 
the goals as cAystatlAJUuUon 
occu/ts. . . . Oiystaltization 
nonmally nepiesents a stabiJLiza- 
tion oi thought. A setting o^ 
thought is adtiieved which is 
ondinaAily o^ some duAobility 
and hence o^ sme reliance. 
Thi6 set readies the penson ^ok 
investment o^ seli along a 
tine that then becpmes mofie 
noticeable. The situation 
becomes defined, so to speak, 
at least jjo/t a time Ip. 41).'' 
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T/ic iliitd ifugc c5 tliat choice, and 
it (^oiloiVi> Xi*aduLj on the /iccti cAij^tat- 
tization. 



"With du'tcc, a piixticuloA 
goat, and it^ iti\!vant {^i^Jbi. . 
. . . attciiti £/ie bzliavioKol 
4t/4tcm OjJ f/i(^ ptuon A.e£e- 
vance {{t*^ hh p^ob^cw, . . . 
Tlii6 goat my be ejected u?^fi 
vaxying dug/izu ^QAJjaiyUy 
and Its motwz poive/i loWt vaAy 
06 a ^eioW. . . . fuAthoA- 
moie, t/ie dzgKzu cla/UXy, ' 
complexity, atid ^^zedom genCA- 
atly avaliablz to thz poxson 
in thz solution ajj this p^oblm 
and in thz puAMiU o^ thz in- 
dicaXzd dzclslon mJUL also z^^zct 
thz motivating poivzA OjJ thz Kz- 
sotting KZySotxiXion attoA- 
ywutivzs (p. 42)." 

Thz ^ou/Uh and ^Inat stagz o^ antici- 
pation is caltzjd ctaxi^icjotion. You 
iAkJutd expect once a choicz liad been 
madz tiiat aspzcts dzcUion making 
iA)hich precede acXion muZd havz been 
finished. Bat zvzn ttiough thz 
dzcLsion is madz and held ^iAmty, o^tzn 
doubt about thz dzclsion uUlt a/Usz. 
Thu is t^juz. . 

"in zvzn a shonJ: pzxiod o(^ mix- 
ing [a tceefe ofi moxz, say) ^ox 
thz expected situation to bzgln 
to unsold. . . . Doubt zxpzA- 
iznccd in t/ie uxiitikig pz/iiod 
coasts thz individual ^an^thzA 
to da/ii^y hts anticipate 
position. An zlabonxition and 
pzA^zction 0|J thz imagz o^ thz 
(sittuAZ. . .znJSuzs. . . XtoAi- 
^ication not only pzA^zcts thz 
ijnagz o^ szl^ in position, but 
also dissipates somz o^ thz 
f^onmzA doul ts concerning thz 
dzcision (p. 43). 

Accommodation 

Thz thxzz stages oi accommodation may 
be bKiz^ty doJSCAibdd in tiiz (^olloijoing 
my: 
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''InducXion: A gznoAoZ de(5en6e 
6eZ^ and a giving up an 
a^ptcX oi hoZf^ to gKowp puApo6z 
. . . thz individuaZ* goaJL 
and ^Ittd as6imJtaZivzly 
bztomt a poAt thz Kojgion 
... 0^ thz hocJjit hy^tfim in 
Mrfucc/i thz pM^on i6 i/nptemznting 
ku duvizd solution kU 
pn^obtm. He lejOAnA thz p^mUu 
and 6tAJdJCJtiJJiu-in-intQAacXi^ 
KzqtLiAzd {^OK tontCnaed idznti{^i- 
cjoiion. Tku pn.ocu6 leads to 
a ^uAXheA peA^ection ol ind- 
ividual goal and ^ieJtd in thz 
social system. . 

^^Rz^owmtion: The /izczptive o^ent- 
ation 0^ inducXion igivu). . . 
my to [an) asseJUive oniznta- 
tion. ... The pexson is u^zll 
imtued in a relevant gftoup 
• • • • He has a st/wrtg sense 
0^ seti and actively enjoins 
the gn.oup to do betteA. . . . 
Since. . .the poxson acts both 
upon the in-gnoup goal and 
iield. . .in oAxfet to bnA.ng 
that gn^oup into gftpjvteA con^- 
otmnce mAk his modified goal 
and ^ietd. . .and upon the oat- 
g^oup to bating theOi view o^ 
his identification into gn.eateA 
cpnslstmiy mXh his, the eiiojct, 
ii any, is the modification of 
g/LOup goal and fioJtd. . 

"lnte3n£Ltlon: Synthesis is, of 
cou/ue, the essence of integnxi- 
tion. . . , A dlffeAentiatlon in 
identification has been achieved. 
The MMh found appreciation of self 
is integrated voith its la/tgeA 
field. This nojjo toa/it of £he self- 
Si^steifi becomes a loorking member of 
the u^hole self-system. In integnja- 
tion, individual and group both strive 
io keep ate resuJCUng orjgancz- 
atlon of collaborative activity 
.... The iriividual is sa- 
tUfied, at least temporoAlly, 
when integration occmas {p. 44)." 

The above two aspects and seven stages have their general origin 
from logic and from Super's (1957) theory of career development. Harren 
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(1966) lias ad<lltionaliy made an ingenious empirical application in which 
advance of vocational decisions up the steps of the Tiedeman stages was 
shown to bo associated with year in college* 

However, the above formulation has two limitations that shall be 
removed in this paper ♦ First, since it was a language predicated on the app- 
lication of Super's 1957 theory of vocational development to a particular 
vocational decision, it somewhat clumsily incorporates the macro conditions 
of a single vocational decision which is only a part of that lifetime 
vocational development. Second, since it was language predicated on the 
assumption that the individual cannot be a part of self science, it talks 
about decision — it does not talk about the person comprehending while making 
decisions. Therefore, choice will be discussed generically and how it re- 
lates to the person deciding. 

Seifliood and Career Choosing 

Tiedeman and^O'Hara subsequently moved beyond their 1963 centeriig 
ot decision-making development in the process of identity formation (cf. 
Tiedeman, 1967, 1968, 1969). Their early union of decisionmaking with 
identity formation made a tentative place for self-comprehension in career 
development. Their work with others, particularly Kehas (1964) first 
clarified the relationship between self conceptions and self concept 
thereby recentering interest on selfhood as. the principal prod uct of 
career development. Field, (1964) next introduced a philosophically and 
empirically consistent con|:ept of purpose as the mechanism potentially 
guiding career development. According to Tiedeman and Field (1962): 

"We believe that to establish purpose in Guidance, ends 
must come into existence before, or simultaneously with, means. 

This premise does not involve the issue of teleology, as might 
be argued. A goal, if defined as 'a desired future state,' 
certainly cannot exist prior to the means for its achievement. 
But a concept of this desired future state can exist ia the 
present. Thus it is quite possible to compare the present state 
of X with the concept of a future state of X, to note the differ- 
ence, and to choose, develop, modify and perform a series of 
actions designed to reduce |:his difference." 

"This process is what we mean by the term 'purposeful 
action. ' It describes: 

1. the behavior we hope to encourage on the part of 
individual students; 

2. the behavior we hope to make more practicable for 
individual Guidance professionals in education; and, 

3. the behavior we hope to make more operational in 
training such professionals through the mutual development of 
professional theory." 

"Thus 'purposeful' means 'not random,' i.e., 'more likely to 
acliieve the currently desired by acting contingently upon the 
(urrentiy observed.' It is our current observation that contemporary 
activity in education is undesirably random in general and undesirably 
constricted in particular instances." (pp. 489-490) 
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Finally, Field, Kehas, an*' Tledeman (1963) put their work together to make 
the person become not alor^ the agent of his career development but to offer 
the possibility that the person can through the simultaneous hierarchical 
restructuring of the self enlarge his selfhood as well. This latter effect 
stems from simultaneous comprehension, of decision making development during 
career decision making. Achievement of this effect by the person without 
the shackles of language or expectations of others requires hierarchical 
restructuring of self comprehension in the process; Why and how? 

Allan Ellis in designing and in preliminarily testing the Harvard- 
NEEDS-Newton Information System for Vocational Decisions on which He worked with 
Tiedeman and 0*Hara and others provided explicit statement of the extra- 
corporeal relationship which is needed to comprehend those parts of self 
which are known to others but not to self (Fuller, Bown and Peck, 1967). 
Heretofore, there has not been an explicit statement of the ultimate in self 
centering — the taking of even more appropriate responsibility for one's 
decision making in growing awareness — during declsion-^making development. 



gh a gloA^ da/ikZy aj/i ku 1963 monograph 
uUXk O^HoACi. At that timz he KOjaJUzod 
that tht 6tage, IntiugKatAJon came ^njom 
the, ptupzctivz 0^ Kzjolifung tkz neuitt/ 
diiivitYvUjited concept ^e£^ \joith tht 
JUxAQQA gutaJU oi 6eJt^. Hovotv(>A, a6 
indXcjoted abovt, Tlfidemn wtw at that turn 
tJiying to be compteteZy obje.cjUvt 
about tku p^ocu6. He did not ^eotcze 
that the, concept o^ ie£^ ceittetoig 
in dexU&lon-mafUng dtvziopmejat ^eqiuAeA ^e 
abjzatiiication expe^cence ioK (vnothoA 
uUMwiit luj> concomnuLtant ^ubjtctiii'' 
cation to the. concepts on, language, 
that obje,ctLiAXLation. 

UJLU and Titdemn {1969) cjontend that 
the, pn,obtejn o^ obje,ctliying the, expe/uence 
^oK anothe/i uibthout 6ubje.cting kirn to 
the, obje,cZLiy<ng concepts >U the, centAnZ 
pn,obtem. Thzy oAgue,: 

TheAe, jU 6omeXhtng pecuJUjCUi 
about {Tiedeman^ 6 and 0^Hana^6] 
pa/iadigm, a pote,ntlat di^^iaxZty 
quite, ^XmJlxvi to the, pnobtem 
u)e, 6omeXmt& get tnto vohen voe, u^e, 
language,. A pejiJuJUjvuXy oi 
language, knom to phito6opheA6 
ion, 6ome, time, >a that among 
the, tking6 voe, u6e, language, to 
talk about 16 language, AJtieZ^. 
BeAt/iand Ru66eJU, ^on, e,xmple,, 
hfu 6hom that it a cjue, ol 
bad phiZo^ophical synXax to o^^eAt 
6omeXhii(ig tike, ^The. gotdtn 

II-3.8 



107 

116 



mountain docb not i^xLbt/ anct ^n,om 
that iup/jcjc tjou ti/ic att'iibiJiting 
5ome iiind o(^ cxu fence to thz vQAy 
tking dioie excite nee i6 d^^td 
in tli^ icatencc. A6 tmQiioiQZ 
dou 6om(itimc^, the pcviadigm 
dzcAAAjon making taAn6 bactz onto 
ctie^ij in a my w;e mMt be ctzan. 
about. Not only dou tiio. panjxdlgm 
dzpict tht deox&un pn,oce^^, it 
ai^o bij tiM depiction pMi^oxibu 
/low; ont >bkotj^A Milatz to that 
pfiocu^. Tiiat in zmyiciating 
f/ie a^pzcX c<5 accommodation, thz 
pcviadigm o/iguc^ that onz o{^ thz 
tidings to iA)h<di onz mu^t accom- 
modate the. dtct^ton p^ocU6 
>it&2Ji^. Bixt integKotion aj> thz 
dtvetopfm^it mzaning that ^ci 
indzpmdznt o{^ language as thz 
insVimznt o{^ that meaning. TfioA, 
tiiz language 0(J dzcAJblon mfe^wg, 
ei;ew though it i^ tkz moJuxm ^&i/iough 
iA)hich undoJtMtjxndtnQ o{^ -t/ie p^oce64 
comei, mu6t be thxom o^^ bc^oKc 
the, accommodation i.^ complete. 

Tki6 th/iovoing - peAhap6 making 
invtSiibte a bette/t tking to 
6ay - Oj{ the insViment 0(J mejaning 
UuggeJ^t6 the needed play) betoeen 
the extexnal and the intexnal 
imposition o{^ {^onm. . . .Kccom- 
modation to decision mailing AJt^z^f^ 
is the most geneAjOl kind^ since 
it n,epn,eseyits bvteJmatization o^ 
the processes o{^ Ke^olution. 
Fiut the language mast be eJb- 
tabtished {^OK the individuals [in- 
duction) , then it mix^t itseZ^ be- 
come an object o^ analysis ke- 
{^onmation) ,and {^inalZy it ma6i dis- 
solve, as the irvdividual gots 
past it to mejining {integration). 

By way o{^ the e/ssenttally oAtistic 
activity {o{^ counsetiio^g) , the 
counselor must take his cltent 
through these phasts, not i'Uth 
rtspect to a paAticular problem so 
much as \joitk respect to the proceJtiS 
itseX^. He mwbt e^tablif^h the 
ctient^s pro{^iciency in the lang- 
uage 0^ the proce^s, deveZop kis 
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aMAtnU6 ojj tkl& tangmgt and -6t6 
eiJiJec^ and, in the. ml, iaoJUUMtt 
thz individiioZ* 6 inteAmtizcuUon 
tku p^ocU6. In doing tJfvu, u^e cjuguz 
that tht coanieZoK tzavu thz cJUent 
iAuMi a 6eMz agency 06 a logicaJt 
cowAeqtience. Tfie 6tatt in wfucfc one 
betitvu Ifiimet^ to a 6ig¥iiiicant 
agent in doXMnujung i/ohat happeM .ta 
hm comu not ^Kom convincAJig him about 
it but ^Kom tht intejmatization ojj tht 
dzoJUijon pio<iU6 (pp. 24-25)." 

Tfiu iM ouK AMiing point, thz point 
vohich move6 lU in.om thz old to ^e new. 
A6 we gencAotize the. condition o^ a6-cng 
ianguagc to expiain loithout de^jeJmininQf 
(joc ab(mdon tm heA.tto^oKc JUnUting concepts- 
nameJty, (7) uAing something 06 gene/mZ 06 
thought- guided action only in the 6n^aZl 
context ojj coKcex, and (2) JUmJbuig ouA- 
6eZve6 to the KeJiatijon6hip o^ mon and 
machine 06 ElZi6 and Tiedeman did in 
conceiving action in the loAigeJi context 
oi comprehending Ke^pon6ibiilty ^on, 
guixiing one* 6 action by thought. We, 
theJie^oKe, abandon guidance-in-educaJU^n 
ior guidance-in-tejaAning 06 Tiedeman 
Kecently did (1972) and 06 MaAJtand 
advocoute^ in kU concept oi CaAeeA Education 
(1972). 

THE MULER-TIEPEMAN GRAMMAR OF PECISIOW MA/CIWG 

Tiedeman and O^Ha/ia laid out decUion- 
moking deveJLpment 06 it can be 6een by 
anotheA u)hen the peuon taJik6 about hi6 de- 
ciding. Tiedeman and EJUi6 laid out the lang- 
uage di^^iculty u)hich a/tUe^ u)ken you help 
anotheJi 6ee t^at you do about kU decl6ion- 
making development. We not/o 6eek to avoid that 
language di^icuZty by indicating hou) you can 
help anotheA veAbaJLize tufiot you 6ee happening 
to him. HotJoeveA, in doing 6o, you mu6t take 
pain6 to 6ee that he biom t/ohat that language 
meoM ^oK him6eZi not jU6t ^oK you. OtheAi/ixUe, 
he ha6 youA language- -not hi6 a)mpn,ehen6ion— 
0^ (johat and hou) he expeAience6. K6 one help- 
ing anotheA, you muj6t caju6e a laAaeA peupective 
than ja6t the decibion it6ell ^ 6een. That 
i6, you mu6t cau6e the peMon to 6ee kim6eZ^ 
deciding {MiZleA, 1971). Voa ma6t Kexiognize 
that the ifMAT o^ deci6ion ma6i oAdiyuvtily 
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precede t/ic WHV of^ dccUionJ 

TiQjdcman, O'Hcvia and EULU (UiJiJeAeittcatcd tkz 
WHAT, HOW and WHV dzculonA a6 thzy planned 
the, In^onmation System ^ok VocatioYv^jJi VzcUion 
(ISVPL The vQAy my in u^ich the computeA 
mu6t be pfiog^ameA ffiK poJi^onalty-diAetted 
inqaviy (Jo^ceA tlie p^ogAasme/i to expect a 
di^^QAent Kt6pon6e wfien a 6tudent l& exploring 
in hie Sy6tejtt than urfien he jU cta/U^uing a 
decision In the System. In the ^onmoA condition, 
the System trmt be pfiognMsmed 6o that the student 
(/) may go ^Kom pption to opilori at mJU, (2) 
expoJilenze generality mjthoiU too much dztiui, 
and (3) not be held accoixntable io^ knom^nQ 
beio^e he and the System agxee that he knom 
WHAT, In mXting about the JSW, Tledeman 
always distlnQiLished thut tm oafaoApectA o(J 
the Tiedejnan and O^HoAa AntaUpato^y Phase oi 
decision-maklng as EXPLORATION {ujhich JundUidoM 
eKplofidtijon and cAy^taZtization o^ the dojCAJiion- 
making poAadigm) and CLARIFICATION [viitich includts 
its choice and dLoAiiiaxtion st/XQejs). The vtamts 
voeAe kept the same as tm oi the steps in the 
poAadigm becmjuse they had simiZoA piopeAtizA, 
but the dejSignaZion ms .dl{^{^QAentijated so that 
the pn,ognjamming"0^, in ^caLity, the inquviCA^s 
psychologicjal states oi EXPLORATION and CLARIFI- 
CATION--coacd be didnotativeZy distinguished 
i^om the logical conditions OjJ theiA analogous 
CKplofvxtion and claAi^ication steps. 

WiUon (1971) subsequently elaborated the 
JSW concepts in relation to the System^ s 
intent to help another comprehend kanseti in 
deciding. Itiilson postulated and demonstrated 
that xhAee levels o^ activity occur in the 
teaching o^ decision making. 

LeveZ 1, "learning about," concerns 
cognitive aukVieness o^ decision mailing 
u)hich is obtained through verbal, 
abstract means. Level 11, "doing" 
evolves both cognitive and non-cogni- 
tive amreness mich are developed by 
making decisions and ieeZing both the 
interplay oi iactor^s going into a 
decision and the impact o^ that decision 
on Subsequent ones. LeveZ 111, "doing 
uUth omAeness," ^lom irom the amreness 
0^ the personal cAiterta used to establish 
priorities mong conflicting valuer and 
the chanacteAistic pattern o{^ the 



individuaJtty dttCAmined hUtoKy 
dexUding {pp. 24-25). 



MULER-TIEPEMAN CUBISTK MOPEL 

Tfie new tliJUeA'Tiedman cubl^tic modeZ 
0^ dtcl&lon mking dAom togetket tfc^ee new? 
bulc e£emeitt6— die p^f/cltotog^ccat, pfioblm, 
and ^efcjj-concepfuatizing ^tote^. TfiiA modzt 
i& pn,tdlcjUzd on the, iact that tkt ^kncm 
^ bthx\)lofi ol tht wfio^e and the, knom behoLvloH. 

a mlvUmm knxMn paJU& o^ten maku po66ibtt 
tht dl^covoAy oi the, vaJUieA ol the, KemoLlKing 
paAJU, 06 doeM the, knom 6\m oi the. ang£e6 oi 
a t/uangte, piiU tkt btoicn bzhavloK thM,e, 

it6 6lK pa/tJU make, pohtlbtt e,valuatAjng the, 
otheM. Topology pfiovldz6 the, 6yneAgeXic 
meon^ o^ o^aeAJtaining the, vaJbiu o^ any 
^y^tem expe^enceA^ (Fatten, 1969, p* 73). 
AtcoKdAjigty, we move, ovji. dUcM^ion injom the, 
poAX [ckoAjte. In cxviteA] to the, wrfio-te (cfio^e in 
tc^e) In urfucdt choice in cxviteA InhexeM. Even 
though the, configuration in the, hiticipaXion 
Pha^e, H,emxin6 the, Aame,. tfce consent i& expanded 
to inctiude, tm piychotogisial 6tatu: (I) the, 
problem- doming 6tatt {thz p^ychotogAJLjJi 6tatc 
oi EXPLORATION in the vlcMiiouM paAt oi the, 
' ticipation PfeoAe) atftd [2] the, pfLobtem'6otving 
Atote {the, psychological state, o^ CLARIFICATION 
in the, acting out paJtt oi the. Anticipation 
Phase,). The thiAd ps togical st^te,, soliition 
using, is mani^e^t in -ute Accomodation Phase,. 
Solution using in the. Accommodation Phast retains 
the. induction, Ktiowmtion and intejgfuxtUn 
substageu^, but the. contejfit oi thejse. stages 
iocuscs on conditions suAAounding geneAic 
decAAion making as opposed to avie,eA decision 
mkJjig. HovotveA, the, existing content ficla- 
tXve, to a ux/iteA decision /temacn6 yalid wfien 
one is involved in a cwieeA decisijon, as 
Ticdeman oHAjgimtty intended. 

Pn^oblem-ionming Activity 

In pnoblem-ionming activity [Antixiipation 
PfioAc), the individual expentences vicoAAOusly 
all iouA stages oi the decislon-making paAodi^: 
(/) exploration, (2) cAystaUUzation, (3) choice, 
and 14) cloAiiication. In so doing, he ijncoKpo- 
nates the decision-making skilts on, stnategies: 

\ 
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(J) dc{^inii\g t/;c p^obtm, (2) aolZojoXitftQ 
in^cimation, (3) iccui/ung attcAaattvei, and 
(4) rnatxwg dicucc. 

T/ic lujJUimxk p^ob£GJn-^o/iirwiig activity <^ 
tilt gcbtcuU OjJ Aowet/tcng t^^tcfi bting 
6ougtU bat cannot yeX be iulty oAXlcalated. 
In thi^ acJtiviXij, tfie p€^ow pe/iinct6 kiMoZ^ 
to be dutunbod by th^ inconsistency in Aowe- 
tiitwg he has obseAvcd and somztkuig kc Mmt6* 
He 6tt6 pernio defect t/tcnttyig. He £et4 fucA 
xmgxmtton /utve pf J':;. Hu moirf Miowrfew to 
Aecu^e that "thcoxy o^ the a»fiote" wfuxifi ttudes 
him (U <ie "fewow^A" bat cannot oAXccu^ote, 
Potanyi (1966) indicates about the tacit 
dunen&ion in problem- ^oMniiig activity, the 
pCAAow Aeefei to mafee ciwp^tefieniion move 
ii^cirt the /icAe 0^ n(KA?to tfee t^ic/te o^ t/ien; 
t/ie pe/iAOw lumAcC^ b'^idged tfeoA,e two co«fitctcon6 
in ki6 compiehetf^sijon. PKobtesn ^oHming my voelL 
\equAAe t weefc, a montfi, a qaanXeA, a yea/t ok 
even moKt ^ox incubation^ The jpeJUon docs not 
fieadity de^im lumeZ^ in his envincmental 
6<tiJuition 06 i^ theAe ufeAe a pAobtent i^hich he 
compAehends. It takes texs^jjie. It tafee6 tkonQkt. 
It takes contemplation. It tdies attention. 
It takes time. It takes guts. 

In pfioblem ^onming, the pejison engages only 
in hrnvJUted inteJUectual acXiv^Xy aboiU hUs 
problem. But notice that ice have bKoaght the 
60'cattejd "decxs ion-making skUZs'' Into the 
f^oui decJj^ion-mkAjng stages as a naXunaZ adjunct. 
We did 60 becouAe voe beZieve that knomng the 
logical 6e^ae«ce6 oi steps alone in the pfioblem- 
solving acxivitfj voill not result in knowledge- 
able decisions. In the dccision-making Aealm, 
Coleman {1970) suggests: 

In a simutatixjn ok game, the student may 
texixn tc peAionm veAy ^eUL in a given 
decision-making cjxpacity yeX not be 
able to venbalize vohat aJtl mist go into 
kis action. In lea/Lning the same mate/Ual 
^Kom books, a student may be able to descAAJbz 
vdiat eJLements go into a given dexUsion bat 
not be able to make such a decision 
coKKectty [p. IS). 

Consequently, voe believe that theAe is moKe 
to tifte decision-making phenomenon than simply 
knovi}ing the logic oK Steps in a dexUsion-mking 
pKocess. That is vohy m. haoe nested those steps 
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0^ tht p^blm-iom^ and -6otvinQ activity 
fuxthoA than oi a ^zpanatt l^nuiQ exeAec6e 
placed out ojj context mXh the, matwiaZ to 
urftccfe it KdLatu. Tfie mphoi^ijb iM on twAn- 
ing i/okiXt expojUdncing the. tatat pnficz66, not 
jti^t a fWit o£ it. 

Rtcogrtttion o^ tht iovJi dejiUion-making 
6tagu {jihiJtt vicxvux)uAty oxpe/iimiuig \tht 
pKocut oi dzci6ion making fieip6 impftdvt 
de^cUion^. Expe^encuig thz ^ou/l 6tagu u)kite. 
not acting on the vixMUou^' choice ion. a 
houA^, a day ok a weefe aJUom one to che.dk to 
6CC il thAM i^ a "ch/cven dcci6ion^^ oK a 
"puApo6tly cho6(Ln one," bccamt ^ a dntvojn 
decision- -af^2A the isfutiaZ taave o{ de^-cte 
6ub6idzs-'theAc iM no choijcc 06 the duvic fui& 
iadod. The vicanJioixJb cxpoAlcmc pKovidu a 
check ioK vo/uooA typu o^ dojciJbion makeu, 

?Kobtm-6otviifig ActtviXy 

PKobtem ionming and 6otving have the/Ji iMtcA- 
6ked at the point tofeen the pcMon mov<L& 
imagining hU> "thojoKy oi the ifkole" to potting 
one on mo/te aApect6 oi that "tkeoAjf^ to the 
te6t. iHhUe the haJUnuvtk oi pfiobtm-ionmijag 
activity lb the gutaZt oi something uJhAJch l& 
being bought bat cannot be ivJtly anticutated, 
the haJUbnoAk oi pnx)btm-6olving activity lb that 
vvuj oAtiojilation lUeZi. In pKobtm solving, 
thobe thlng6 that belong mJk the '^theoKy oi 
the w^w-tc" nmt be ab6ijnitated to it; the wind 
rmibt iind my6 to put them together ob paxtb 
into the [dkote (jokich lb imagined. 

In hie tiiJUeA'Teedeman aiblbtlc model oi 
the declbion'maklng pnoceb6 tee pKopo^e ti\at 
thlb a/itlculatoKy pnocejb6 needb anchoring In 
the 6eti pnoceb6 oi explaining to anotheJi. 
TheJieioKe, the iantheA hailmaxk oi pfiobtem- ' 
solving activity in thlb gnamm/i lb ^pfiobtem 
bolvlng uhile teoMilng abovJ: one 'a i^eli ^om 
anotheA^ OA In CoAeeA Education. Thlb 
neceb6ltate^ the abe oi cxinxent expedience 
mth both bad and good dexilbloKb. The^be 
declblonb become pivotal in leaAning about 
youAbeli inom anotheji. Kb tee leann to talk 
about both bad^nd good declbionb that w^e 
encoanteA in evexyday tlie and to be mo/te 
eiiicient udith the dexilbloKb, then w>e con 



11312?- 



imfyiove qua louj-nA^k and t(njO''C06t dexii&ioM 
i\)lUdi, in tuAifi, tuiW px^paA^ a6 to bttteA 
iiandtz tho4it dtcc6iofiA ^UXh kigh >tc6fe and 
kigh co6t. 

K^tQA thz problem" ^onming htatz ^ 
zxpoAlzncQjd, thz dexu^ion pn,ocU6 jU ^uJtty 
n.e." enacted. But in pxobtem-6otving activiXy, 
the dejCAJilon i6 acted out at thz chojixie, point; 
tke decision is put to the tejst again and 
again attouiing the individaat to expe/iience 
at texut tujice tiie cZani^iaition 6tagz in 
deciding. Hou;evcA, duAing the pHjobtem- 
6otving 6tate, voe believe it is important to 
show anotheA u)hat he Is doing vokiZe. he is 
doing it. VUs ijs tufie^e Mct€e/t'A {/97?) idea 
0^ tiie peAJSon-to-poAJSon intoAxction needed f^oK 
centexing tiie pAobtem-hotoing pnjoctS6 in the 
6etl becomes impoAtant. HcAe one poASon 
teaching anotiieA pennon can ^uAtheA elucidate 
ihe WHAT in tlie pAobtem" doming pAoce&6 a& 
mUt as the HOW in the pn.oblem'6otving fviocew 
mXh that indjividaat. When anotheA can a66ist 
as to "do voith aMiAenes6/^ voe can ^ocws on ouA 
behavioA in the pAobtem-i^oming as wett a6 in 
tiie pAobten\-6otving phascjS and knoijo what it i6 
that we did that made the choice 6atis^ying 
and/oA diS6atis^ying. Then, making a choice 
whicli makes oua ti^e di^^eAcnt bejcomes 6ome- 
tiling we ^eeZ we do ^oa oua 6eti-enchancement. 
We then begin to ^eeJt a 6ense ol inteAmt 
contAot. HoweveA, what we aAe attempting to 
do iji tatiiing about peASon'to-peASon intejiaction 
is to cAeate in the AntJjdpation Phase oppoA- 
tunitics ioA intAodacing this hocial act ojj 
seeing youAseZ^ a6 othenjs witL 6ee you in 
Aclationship to what you oAe telling them you 
6eek in the Accommodation Phase. This is an 
act which we no tongcA ^eel has to be AtseAved 
^OA the pAo^es6io>^al counseloK. The act o^ 
helpik^g anotheA 6ee him^el^ is a pAimaAy skill 
in teoAning this valuing pAoces6 with 6el^. 
We tAy to give that expeAience to students when 
they OAe helping anotheA 6ee himsel^^. Essentially, 
we ^ind out some o{^ what is unknown to us {but 
knoum to anotheA) in the intenaction with anotheA. 

Case Study > The new use of the Tledenian paradigm of decision making 
is illustrated In the following case. 

At 26 ShaAon had a masteA^s degAee and ^elt 
veAy capable in most aAeas 0(J tivifig. She 
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began to Idzj/vU^y hoMeJLi (U an hitpuJUlve, 
de<U&4jon makeA u^en hzJt iiajnco. 6t(vuted to 
\)aJUdatz hoA doxu^ionA ^ox heA. Sfee then , 
idejfitiilejd 6tvVtal dexU^ioM that had not 
tu/ufizd out too voeZt. Shz Ktc^ognized, ^on, 
exompte, that 6ht had a tot o^ item6 in hoA 
cJto6eX& and hotuthotd that 6ht did not uoejtvi 
and did not tUze,. S/ie (0X6 not dUtuAbzd by 
thu 6iJtmtion too much at ^iut, 6o 6ke 
di^nU^^ed heA discontent. Sutce ^^e aJ(ukiy6 
had moMjy to 6pe,nd, 6he did not have to be 
coKe^ut about heA baying. 

^lOAon ma/Uiied a yexvi lateA, and heA 
financial 6tatu& changed cjonj^ideAobty. She 
did not have as muck money to 6ptnd. Con- 
sequently, 6he began to look at heA geneAol 
dejuhijon-making habits. HeA husband bejgan to 
complain about the excei^. Me pointed out to 
heA hom) much 6he bought but fuuiXJUy did not need, 
hou) much make-up 6hz puAchased bat did not cue 
o^ten, hou) many cZothes she mAe once on. tmxie 
then ignored becjause she gxeia tiAcd o^ them, 
hoi/o many ioigs she bought bat only tJOOAe ocaisijon- 
ally. Then she began to notice heA f^esent 
sitaation—hoi/o many things she thought she 
ukinted, but did not a^tcA a mek^s unit. The 
doming xeatizatLon that nohat she thought she 
mnted at the moment ms not always satisfying 
in the long Aun cmjsed ShoAon to Aecogntze heA 
style of decision making, and she taa6 able to 
change heA behavior. This change (MS based on 
the ffict that she ms noi/o able to identify mo/te 
of heA ijnpal&t6 as she expeAienced them. Bat, 
though she stilt expediences defines as befoAe, 
she now Kecognizes they may be only udums that 
mil pass. She can now mtt to see. ThU 
behavioK geneAolized to heA coAeeA decjuions 
as yoell. 

AfteA being moAAied sevenal months, ShoAon 
began to seek employment in heA field of iJiain- 
ing, sociology. HoMeveA, jobs in sociology 
uie^e not plentiful in heA aAea. She also had 
tnaJining in business {j^ntch gave heA a secondoAy 
skill. The salaAies being of Weed foK these 
jobs weAe good, f^om $S00 to $1400 a month. 
At fiASt she became excited about the money, 
then bejgan to realize that money iMS not all 
important, that otheA factons needed consideA- 
ation. Before. heA recognition of style in 
heA decisijon making, she laould probably have 
accepted a job based on heA fiASt impulse 
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about ttu job, 6a£ai(/. 6af >C/ic at«a/tene64 
o(i he% impiitbivt natiixc in dzcUion making 
«ou> made iwA aiutioM about deciding qiticktij. 
S/ic did not mfU a job lirfioAe aWuicXion nUglut 
({ade, tliQAtbij ncceMitating fim&/ozd job 
/ituLtingr^ S(f puuued th^ moAko^ ^u/Uhex 
{6omeMiing wouZd not /lave done bcjjo^e). 
She heixKchzd oat lioA po66ibiJtitiu , tewtnod 
ottcA^iatAvu . At t/ie point urfie/te the decX6>con 
i& ijLSuaJlZy made, ^fie huiXatad boAOxi on fieA 
fenotiJ^edge ojj feeA p^ev^ooA Atifte o^ dec^^ion 
making -'imfol&u KUuZting in txitzA amoanted 

She KzajcZcd and mited untiJt 6hz ^etC 
intititiveZy 06 a»e££ oA in^onnuvtionatiy good 
about a job and until thz duiJiz fiemunzd 
constant. Shz thzn made thz dzcAJbijon to takz 
a job uiith a juvmilz biiAeau wfecAe 4fie couM 
uiD^fe luct/i deZinquznt boyh. 

Ho to. that ShoJion oAed tkz AtepA in the 
- deci6ion-making pftocU6 in the natoAat activity 
oj{ making hvi vocational deci&ion [i.e. dz^im 
heA p^oblm, collect in^onmtion, lAJcigh altcAna- 
tive^, and ultijmteZy ckoo6c). The impontant 
(Jact ii that 6kc mJkheld a deccA-ton even though 
many o^ the jobs appealed to hen. and hen. old 
imput&e muld have been to accept. Instead 6he 
mited, talked tmXh heA husband :and ^endA, 
then acted out heA choice {pnoblem solving). 
In othcA mnds, she mmouined in the pnoblem- 
^onming state, keeping in mind hen style o^ 
decision making; and on KecycJUng vohen heA 
dc&ine n^emained constant, she selected the 
juvenile job instead o^ being impulsively dniven 
to that decision. She thus ^ul^iUted the *^doing 
mXh omAencss*^ step in Wilson^s scheme o^ 
decision mcdiing {WiUon, 1971). The behavion, 
genenalized, and she i^ noijo mone deZibeAote 
about heA decisions -seeifig i^ possibiZitie^ 
appeal to hen laten as well as immexliately 
{solution using). 

The above case illastnates the ^act that an 
individual not only needs to know the steps in 
the decision-mahing pnocess, but also needs to 
centeA on kU "sel^" doing in ondeA to leoAn 
his style o^ decision making. Then the steps 
in the pnoce^s become a poweA^ul tool in lexuvti- 
ing about his style. it ij> accepted that 
decision-making style is the end gain and the 
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thon m ttmt dMeZop the, mexuu to teach w/dzAr 
6tajndLuig htyle. In KoJLcuUonikip to the, ^pe^cL^lc 

Awareness of Style > In discussing the rational and nonrational factors 
of problem solving , one must rely on some accepted theories of teaching which 
are based on the assumption that through specified behavior one can stimulate 
a person's interactions with material with fairly predictable outcomes. 
If this is accepted » it can be assumed that the teacher may succeed in 

inLUoLtbtg p^cewe6 uifttdi did KenoQfUtLon oi 
style, lAiiXh the, pe/L&on. When spexuilc behMAjoK 
occu/iA, one, 6ometimzA con 6ucce,ed in caiuing an 
indivAduat to attejftd to those, behaviou (U 
thejf occuK. UttimateZy, iofieit that concUXion 
exlUs, a skAJUed "co-expcAXewce/t" has the, 
oppon^mity to cAexite, a t/Uptt e^^ect: (!) p^to- 
viding tht langaagt ^jomoofik nectua/u/ io/i the. 
individual lea/uie/t to compftehend mKe, complztety^ 
ku behavijox {both ojjuient and past) by intna- 
diKung the, appn,opnAatz ^omal statemej/its aboixt 
the, dejUsion- doming pfioceAS; (2) iJtJbjuMjfuxting 
the, existing dejUsion-maiUng steps undeJwmf 
mXhin the, indlvlduat at that moment and simxl- 
taneavisly relating the^e, pHJisejnt behaviou to 
the, ijttdividual^ s pnXoK cmpieheMion oi similar 
lomeA behavions; and (3) encouAaging tke, 
Individual vdho Is at that poijvt gaining insights 
into his past and momentoAy behavior to [a] ^ 
think aheiui^ [b] spe/iliy potential means o^ j ; 
satl&iying lutuxe, needs tufucfi nou) oAe, betti^"^ 
unde/utood (c) cAeate, his owi plan iox iul^lll' 
Ing iutuJte, ends u^icfe he. Is mm moxe, oMVte,, 
and [d] Implement hu, then cAeated decision 
mth the realization that his actual iutuAZ 
seZi-sViuctuJie is novo mxe iatZy known. 

H(m,veJt, the In^omal cjo-lnvestigation oi 
pfie^ent dejdLslon making In a pensonal, di^ieA- 
entiated, and hleJuxAchicatly integrated iname- 
voork oi process implies tSfUit the aeclslon' 
making processes a/ie only reJLevant as they 
relate dlrejctly to the person making the 
decision at that point in time. It atso 
suggeMu that the crucial issue is not the 
> iact that the student academically knom the 

steps in the proce^s but that he knom u)heJte 
and hou) to iit them Into his momenta/iy 
CKpeAlencing , idrnt behavior ensues as a 
result ^ and ho(/o satis iylng this behavior 
Is to the peJtson. This makes the steps 
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t/^ci^at a6 (it then ib abCo to ^ateg^ote tJim 
uitu lub aidivtduLLi (^xmQJii}u*ik. RoZtva^it to 
tiiib pohvt, Simon and WaveiX (197?) 6aggQ>bl 
tiioit toe mvibt iQoAn "/lotv c/iange>6 in tkz oJXojndant 
condition- -bo tJi diangcb hibidz tiiz pioblm 
Jbolvtn. and in thz ta^k c.Qn{/iQntinQ ^um-- 

altOA p^oblm-^olving bzimvioK'^ (p. /45). 
ExpZalnA,ng tliCybt p^ocub^^ KzqiuAdJb cinp/iaA>66 
on HOW pa/Lticala/i kuman bzliavicx corrn^b about 
awd WHAT mzdmiL&m canbU It to luippm. Amxz- 
nU6 0(5 tliuz co^idltion^ addb nm dimoMion^i 
to thz pKoblm- doming ^nd pKoblm-6olving 
acAxvity and to doxit&ion making itboZ^. Hotz 
in tiiz cxue Jbtadij that thz HOW occjuA/izd when 
SlioAon bzgan to undciutand that many 
tocAe accjumaiating idiidi 6CAued no cttcat 
piVipo6z to /icA. T/ie WHAT occjuA/^^d i^}il(ln 6h(L 
bzgan to undoA^tand i^iiitz 6hz UU6 ^zzLing iht 
impatbz tliat itb duiJiabtlity may not labt 
i/oith turn; tlieAz^oKZ, tooA actuaZtij ^onming 
anothtn. decision 6Qt oAiich voa6 lUeAa/LdUcjil 
to tilt i-in^t onz* 

Solution U6ing 

Pxobtm solving and notation u6ing, in tuAn, 
/laue thtvi iMttuluud at tlxat point wlidn tiid 
pd/uon putb hib 6otittion to oAC. Thz p6ycho- 
togicxLt JbtatoJs vohidi oac cnlticai in 

solution using (in the autonomous Accommodation Phase) are those of 
induction, reformation and integration in the Tiedeman-O'Hara paradigm of 
decision-making development. Tu? content of these substages will be the 
same for career decision but will be changed as follows for choice in 
general. 

A 6olution iJb pn.(i&umtd to havz bzzn inooyitod 
and put to p^eJUmina/iy tut bz^o^z it lb brought 
mto xzpZjotzd Wbz in notation u^bing. In thz 
Kzpzatzd itie Oj$ ^oixition u^ing, thz pzMon ^iA6t 
Kzmain6 hzJbiJjmt bzcaiubz iii^ pxobtm 6olution 
iuun^t been tnlzA zxtziuivzZy. Thz pzA&on, 
thcAz^oKZ, maintains the., inductivz 6tatz ol 
fae^'ng 6omewhat moKZ othzA-diAZCtzd tixan usual. 
HomvzA, oJb thz pznson zxpzAtznczs Kzpzatojd 
6uccz66ts volth hib solution, hz movzs ^/wm tliz 
Jbtagz 0(J induction into that o^ KZ^omation. 
Hz has thz svozlZzd con^idzncz o^ success and 
povozA oozA othznjb bzcaasz o(^ a dzsvizd solution 
\jchich voofiks. Bat fiziomation oKdinaxily dozs 
not pznszoviz ion^zozA. Thz ptnson lumszli 
bzcomzs oMAz 0^ situations {A)hzn thz expected 
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i(Ul& to rnXvuxitizt. Tho, peAAcn becomes 
otoiAe oi pattoAn in kU activAXy. The, 
poAAon becomes cumaz potzvitikt hoAm md 
6abjagation wrfudi f?e caoAW by hi& solution* 
All tkuQ. concUtiolU tznd to move tfie 4eein- 
inqlij i^oXXlzd into a condition oi ^uAthoA 
vmztXlmojnt and cjouuubt tkt poMon to go ovoA 
ku de^cuion loyjoJiaZ timu and, thzAzby, qqX 
a hA^ZAonadUcaJUy KUtmctuAQ.d ^^olxjM^n and 
4ert6e 0^ 4e£^* T/ie^e nei/o dli^QAcntMition6 
kelp KuyvtZQfiOtQ. thz old dii^lzAZjfttiatLon 
mXh itb totatUy oi bexjtg, Tfie ptuon in 
tku ijntZQfuition qoam peASpzctive upon h>u 
de^cuion and, in that pmpecttve, upon 
himzli ^ ^oJUi* 

In tho, HiJUi£A-Ti,Q.dman cubi^tia modoZ oi 
tha de^cuijon pnocu6, solution u^ing iM mankad 
by ald'{^AQ.Q. activity, {Ahojuuu have anpha6izcd 
vicarious oxpojUmcc a& nexic66a%ij in pAobtm- 
^oming activity and canvzuation uUth anotl^dX 
MXc explaining vohat one knom in pHjoblm- 
solving activity, voc have not intnoduced such 
pAops in soluXion-using activity* Solution- 
using activity occwu in the natuAal state. 
SoZution- using activity occuAS lofien t^^. 
peuon believes he knom something and takes 
oi^ mth it 0^ his om accoAd and guidance* 
Solution- using activity occurs token oAticula- 
tijon has been so tnzeAjfialized that the peASon 
consideu himself in contAol and goejb alone 
to test that assumption. TheAe oAe stilt 
times oi doubt as the peAson inducts himself 
and then enttu into Ke^oAmatijcn as he pno- 
cZaims ku knomng be^oKe the \joonld. Bat 
in solution using, the processes o^ doubt 
resolution have been intennalized* As Ellis 
and Tideman {1969) uiiisked: 

fiAMt the language must be estabtuhed 
^or the individual [induction] , then it 
must itself become an object o^ analysis 
iKe^onmation) , and finally it miSt 
dissolve as the individual goes past 
tt to meaning {integAatLon) {p. 25). 

The Cub t& tic GnaimoA 



The MiZleA-Tideman cubl&tic model oi decision 
making Is the gnammoA oi the needed language 
iA)hich encou^es compn^ehension o^ sel^ in the 
decision'making process. The language o^ 
decision making is estabtished vicoAiously 
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It becomes an object of^ ancitij6l6 i^)iih anothzA 
(U> thz pzxSion i6 pi.obim 6otving, and thz 
individaat go(^^ pai>t it to mzanA.ng in ku 
om solution lulng. 

Thz cubAj^tic modzZ Uzz J^iguAZ I) unitz6 
tliz tlvizz condiZioM inhzAznt in thz dz(ii6ion 
p^oczA^-'-pwblm condiXion, p^ijchologicat 
6tat:z, and ^zZ^-coip^zhzn^lon. Thz coun^zZoK 
ma^t tza/in to kzzp aJil 27 [3x3x3p combinations 
0^ thi6 cubistic model in mind ab hz, in tuAn, 
helps stiidznts also gain such compKzhznsion 
so that they may engage in dzcision making 
^oK thmselves voith set^-mdzutanding , not 
s eti - abnzgatio n . 

hloticz hoiA) ton^tiwusly thz penson^-pHjog^esses 
in gaining undzutanding OjJ hitnseJi^ in think- 
ing vohiZz acting. Thz simplest condition 
j{o^ thz pULSon is thaZ In thz zxtxemz toi^zA- 
Iz^t ceJUL Oj{ thz cube. In this condition, 
thz individiuiZ p^blem ^oms da/Ung EXPLORA- 
TION in thz vicanious pant o^ thz knticipaXion 
Phasz; and hz succzzds in "beaming about." 

But by moving th/iough tixz psychoJiogicat 
states, hz moves his problem- ^oming activity 
to solution- using activity theAeby p^og^ess- 
ing to the uppeA-ntght., Aeanmost ceil-- solution 
ijoitli sel^ oiJoaAeness in the state o^ ACCOmOVATJOhi. 

This theory is di^^zAent ^Aom u)lfiat m 
oAdinoAity undzAstand theoAy to be in psychol- 
ogy. OuAS ts not a theoAy \diich atloios 
anothzA to pAedtct the beliavioA o^ a subject. 
Instead, ouAS is a theoAy ^^)^Uch allom a pzASon 
to put his om decib ion-making activity into 
pzAspective ^oa himself. As such, the theoAy 
is mzAely a descAtption o^ i^hat can be 
intznnally expzAienced. HomvzA, as the 
individual undzutands this cubistic gAonnmoA 
0^ u)luit goes on as he centzns upon himeZ^ in 
thinking \Kkile acting, he gains moAe and 
moAZ povozA to guide his action by thought 
voith pAacticed ease. . 

Un^ontunateZy , voe have no ea^y nostAums 
to o^{^zA about hovo the conditions guiding 
action by thought voith practiced ease matuAO^ 
in the pzAson. HovoevzA, m do have a numbzA 
0^ Suggestions ^oa hovo it might be helped 
to matuAe. 
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A major research area in decision making development:- is the objective 
definition of that development. At this time a definition of the needed 
objective cannot be offered* It is suspected that the stages may be or 
resemble either Kohlberg's (1964) stages of ethical development or Perry's 
(1970) stages of character development. Tiedeman is presently engaged 
with John Peatling, Union College Character Research Project, in intro- 
ducing a mathematical group theory of personality constructionism as 
philosophical foundation for what is considered to be the realization 
which is ultimately developed. 

Investigation of the expected development proceeds within a framework 
in which the individual develops comprehension in a responding environment 
which offers him help but holds him accountable and responsible for in* 
tentions and their caused actions. Formally defined are the needed respond- 
ing environment elsewhere (Tiedeman and Miller, 1973). Tiedeman (1972) 
has also outlined the problem of comprehending hierarchical self restructure- 
ing in the presence of the needed responding environment. In these two 
papers, a person formally interacting in a conqputer environment programmed 
to help him comprehend self while comprehending what he seeks to decide 
is chosen as the means of beginning specification of what will be needed 
for later scientific investigations which will help him mature in self 
comprehens ion . 

Teaching About Decision Making 

In applying this theory, one runs into the problem of how it is supposed 
to work as opposed to how it does work. What is about to be proposed is 
how it is supposed to work. It won't be known until at least the end of 
next year 

hoiA) it dou u)0Kk; but mtit w>e aaqtuJio. 
^LUitheA information about it, tve u3itl 
6iaax(L QUA pKU£,nt thinfung--aiutioning 
you to tmp^ it by youK om expe^ence^ 
and judQmmt. 

Sq.v2AjC(Z' important a/i6U!i}ption6 undoJitiz 
ouA cubi^tic modoZ of decision making, 
nameJtyt 

1. The desired end state of the process^ls living In awareness 
the realization that man consis'cs of systems, exists in systems, 
but becomes himself in transcending systems. Personhood must 
be construed as an open system. 

2. Elements and relationships are together the fundamental components 
of the open systems lived in the desired end state. 

3. Hierarchical structuring is necessary in transcending open systems. 
The self must be put into relationship with Internal and external 
open systems as if the person can comprehend the self's position 

in both internal and external systems. 
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Change of a hierarchically structured but open selt system is 
achieved by hierarchical restructuring of the self. The opened 
self has to be put into different relationship with old'^ compre- 
hension of internal and external systems. Integration to a new 
whole has to take place. Differentiation of old and new parts 
has to ensue. Re- integration of the newly differentiated and the 
new whole has to happen. 

In order to accomplish hierarchical restructuring of self with 
intention, the person must come to operate his open self system 
in awareness. The person must be able to think and act as a 
self system in order to achieve hierarchical restructuring of his 
self system. The person must coine to know the antagonistic nature 
of possibilities and progress. Possibilities are entertained at 
the expense of progress; progress is achieved with the personal 
limitation of possibilities. Progressive hierarchical self 
restructuring in an opening self system requires a solution in 
which a synergy of possibilities and progress is attained. 
Interactive, not singular, pursuit of possibilities and progress 
is needed. The fluid self must be permitted ebb and flow as 
goals and actions shift under changing purposes. A discontinuity 
in situations must be borne with the introduction of some self 
discontinuity into an otherwise continuously existing self system. 

Help may be extended a person in opening his selt system for 
hierarchically restructuring. The needed help must be tendered in 
the form of scaffolding which permits helpers to construct buildings 
but results in elimination of later unneeded scaffolds ,as the new 
structures formed in Construction take shape and later prove able 
to fulfill their functions without help. Provision of such a 
scaffold-like adjuvant relationship in which the helper is able 
in time to remove himself from the structure he has helped to 
build is essential for eventual achievement of the tucught and 
life style set out above. ^'Teaching" decision making in this 
adjuvant way is possible if structured with the care outlined 
below. 

Decision making per se does not have to be taught (Wilson, 1971). 
However, decision making can be improved by learning from your own 
decisions (a) the stages your decisions go through, (b) the skills 
you use in those stages, and (c) your style of decision making. 
[Dinklage (1969) found that 25 percent cl the adolescents she 
worked with were making "planned** decisions. Therefore, it may 
be that some seamen will not need this type of training.] 

For the most part seamen need to use their own behavior — not 
another's — as a base for learning. However, this does not pre- 
cludei?.the use of simulation. 

Understanding of problem-forming, problem-solving and solution- 
using states will significantly improve the individual's satis- 
faction with his decision. 
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10. Improvement of low-risk, low-cost decisions will generalize 
to high-risk, high-cost decisions. 

11. There are "one-shot" decisions for which an individual needs 
specific information, e.g., house-buyi,ng. In house buying an 
individual could make a bad decision, regardless of how many 
strategies or skills he had. Information about such high-cost 
decisions is difficult to obtain. Therefore, information of 
this kind should be given to the seaman. 

The poAX^ ^on. thz tdjacking ovji pn.o- 
po6zd cabutic modtt dzzalon making OAH 
all oAomd you. B^okq, you beg^ yooA tick- 
ing 0^ Mnotntn,, a^^iVio, him tJ/wX knom hoijo 
to makz d^cUioM, that hz dou it zvQAyday. 
TogzthoA, you may be abtz to imp^ovz tivU 
dz(U^ion-m\ujnQ ablUty u)hLch, in tuAn, mold 
6avz kirn turn and momy and gi\)t him a 6tn6t 
0^ bting in cjovitriot and a ddtibc/uvto., con- 
6id(LAzd pvu^on. 

It is important that you get the seaman to think aloud as he makes 
his decision (any decision). By listening to the seaman's verbalizations, 
you can begin identifying his present problem condition. Try to do so 
unobtrusively, merely indicating that you are giving a name to something 
he is doing so both of you can return to it. When you do go back later, 
seek to elaborate the person's decision-making vocabulary in each of three 
psychological .^states. 

Problem-Forming State; EXPLORATION Substage- 

I > 

4 In this state, teaching about choice begins with (1) ways of making 

a choice, (2) the stages one moves through in a choice, (3) strategies (style 
of decision making) , and (4) skills involved. This stage is analogous to 
learning the parts of the body in order to make a knowledgeable medical 
diagnosis. The learning of the parts of decision making is useful to every- 
one since it is a continuous daily activity for persons of all ages and in 
all socioeconomic levels. Therefore, learning about decision making is 
as germane to aduts as to youth. 

The problem-forming state consists' of the person's awareness that a 
problem does or will exist and that a decision must be reached in order to 
resolve the problem in a satisfying manner. 

ExptoHation. In tkU 6tQjp, Tio^dman 6 
0*HaAxi {1963) coifuideA a mmbeA o^ di^^eAo^nt 
gooJU: 

ReZo^vant goal^ oA^ tho6^ ijokich can po66ib- 
ty bt attaino^d {^Kom tho, oppoKtmitLQ^ 
a^60CMitQ,d with tho, pKoblm undcA con- 

6ideA£uUon the, 6te,p cxptoK- 

ation ... a pQX6on coji, in imagination, 
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action, and th^ c^Qct tliat tht pKz- 
tmahty Kccdcd ptmc5C6 may fiave ikpon 
hxm'. It thut pKCmuu about ^cX^- 
in-^itiuttion and the pmon'A attUudz 
(o/t po6tWi^) tom/td each that we intmd 
to doviotz by thz tvar^ p6ychologicaZ 
iizld (pp. 3S-39). 

ExeAcc6e: Have tht Acomon i/oniXz dom a dzci&ion 
he Is going to ^ace. [ExploAJi hkJUitt "de^^w- 
ing thz pxobtm.'') Have hm tut thz znd-gain 
OK goat. 

CKy6taJtZization. 

Vi6tinctlon^ ok diHoAtncQM meAge 
f^Kom thz compahAJ^on oi at taa^t tm 
6Qt^ OK iiolds^.... Thz advantjOQU and 
d^'AadvonXagei c>n be oAcettootei. Thz 
co^t 0(5 tkz ^zveAoZ goalie can coaA^cde/ied 
in KzlcuUon to tkz KztuJin ^Kom eac/i. 
Thz vatuz 0(5 aJitcAnativz^ can tfien be 
a66Z>&6Qjd (p. 47) . 

ExeAc^e; Have ^/le 6Z£anan cotZzct in^oma- 
tion KoZatzd to hl6 dz^inzd pKobtzm, tkzn have 
km took at thz aJUznmtJcyjQ^ . |Exp£aoi 06 
i^kiJUU.) 

ChoA.cz. 

Aa cJiyhtattization occuX6, choice ok 
dzcUion. bottom KcadiZy. With choice, 
a paKticuta/i goat and it& KzZzvayit iizJtd 
ontentA thz bzhavionaZ 6y6tm oi thz 
pQAMon ol KoZzvancz ^ok tvU pKobtm 
(p. 42). 

ExcAcae: Have thz 6zamn makz a choice bat 

empha6izz that tkU choicz Is 6tiZt onty to be 

mitten on papzK, not acted out. \ 

Clahiiicjxtion. This is thz autlcal point 
{/ohzAz thz person begins to think moKe hZJUou^ty 
about his choice. 1(5 the commitment Is 6tAong, 
then tittle change Is like^if to ewAue. 

Othzmise, doubt about the decision Is 
tikeJiij to aKtse in even a hhoKt-pexiod 
0(5 ukUting [a weefe ok moKe, say) ^ok 
the expected hitnation to begin to un^otd. 
This is poAticuJLanZy thuz idien the 
attzntion o(5 thz pZASon may be attracted 
to moKz in^oKjmation o^ AeCevonce to his 
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[on thz duiAt fuu ^oded). Voubt 
(Lxp^Aitnczd in thz mjUUnQ poAJiod 
caa^e^ thz individual ioKthdA to , 
cJbvUiu ku antiupated po6ition. 
An QjtxhoAjouUon and poAizotion oi tKe 
imasz tht ivJbxKZ eiuue^ (p. 43). 

ExCACc6e* Have the seaman look at his choice, think about it for at 
least a week (if possible), talk it over (if he vishes) with friends, 
parents, and the like. However, the seai&an is still clar4.fylng a vicarious 
chdice; he has not acted it out. Acting out is a probla»-solving activity. 

Ac this point, also, the seasan looks at his choice in terns of what he 
values. The Gelette-Varenhorst^^arey (1972) decision-asking aaterlals, 
dealing with values, may be adapted for use in this substage. Also, the 
seaman has not yet become concerned with his style of decision making. Just 
the fact that he has a decision to make, that this decision must go through 
various stages, and that the general decisiun*-maklng skills should be 
Incorporated. Here, the seaman learns the stages and skills as they apply 
to his decision. This learning about stages and skills can be used for all 
his decision making, general as well as career. 

The Life Career Game, as modified by Varenhorst (1970), may be adapted 
to Navy decisions as an activity for the seaman to examine his decision 
making in retrospect — that is, he identified (1) the Tiedeman substage, 
(2) the skills used in decision making, and (3) his "styl<^ decision 
making'* based on the Dlnklage (1969) categories. 

It would then be appropriate for the seaman to discuss actual decisions 
he has made, to identify the four stages, to talk about outcomes in terms 
of what he might have done if he had waited longer to make the decision 
and to see if he can begin to recognize the value of the vicarious activity 
before the actual uecision in the low-cost, low-risk situation. 



Pnjobtm-^objinq 6tatz: CtARIFICATIOf/ 

In tki^ 6tagz, tht peMon tuu thz 6tage^ 
and decu-con-mofe^ ikJUUtM fie haj^ tojojin^ in 
intvu^iCJUon uUXh onotheA team about ki^ 
6tylz 0^ dz<U6ion mofexng. Hot^\.ifeA, ii tht 
dzci^ion-making pKoct66 is individlmt and 
pe/t6onat, hoi^ can anothvi iacJJUtatt tht 
^e>t&e iKtzdom and e^^^caci/ (U^octated uiith 
the individuate 6ati6lactofLy connexion oi 
tht cyctt oi zxptonation, coniiuion, da/Uli- 
cation, cAy6taJLtizatian, and aioiAenm' 
gnoundcd action diAtctod tonoand individucJity 
dttinoated and onganizcd 6y6tm6 oi "means 
uihcAcby" and "end gains" {Tiedemn and O'HoAa, 
1963). 
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T/ic a^uicct may 60 ^uund 61 thz dcj>i.gkung ■ 
f^acKitatipig icCatian^lupb icUk the cnv^on- 
me^it tiiat axe CA^atcd abound, ^ox, a^xd in 
the pcA^on to eZicAt and 6uppoxt /lU centcA- 
ing 0(5 liimcif^ in /lU bcl^ diVUng liU ^eZ^- 
iMtAucticH iPcx-i^, 1969). vznJU co«xendA 
that the c^^c^icc cl tkU cmijr coig p^oce^6 

dtv(U.optd aiMxanu^ oi th&.gutatt, i.e.., 
the 6tt^'in-6ltvAtJxfn. He maJjtXain^ that 
a peMokuit necxi oiid a pax^ticutoA 6imation 
(Viz tx^ piexb 0(5 the bridge in vohidi the 
individmt becomes the gutaU 0^ liim6eli in 
ku 6itiuition. Ueed6 axe the indivichiat^ 6 
ruUivial and individual p^,occ66eA a& he pc/ipet- 
ualty 6eek^ unitij in fia enviAoment. T/iua, 
' need c& an axoiued condlticn voitfun the ptuon, 

demanding an a66ocAjation v^uMi /u4 enviAjonment 
urfUdi u}i(Z 6ati6iij that need. neecU a-^.^e, 
the peuon becomes goal 6eeki^xg; one aspect 
ttie goal i& 6atc6 faction o^ the anoiued 
need. Katz [1954] undents coKed neecU in kU 
pKopo^ed S-po4jnt dc&cxLptive model oi the [ 
decA^ion-making pAoeu6 In vohicJi he pointed \ 
out tiiat the deci&ion-making pAoecA6 i6 
motivated by the individual' 6 needi> akid 
dxive^ and by his beoig aiiWie tiiat these con 
be satU^ied by hU ^ntoAactLon^ MXh the 
' envvionment. 

However, in oua cubatle model, need^ aKe 
expAe^sed vieoAiotuly <n the pAoblem- doming 
state, incubate, and then axe fie- examined to / 
see i^ the dhive ioA tlxat need Is stutained. 
TheAQ^oAe, the centenAng CjJ the individual in 
his self^'in-sltuation am a complete aiwieness 
o{^ his need stmctu/ie and a testing 0^ tliat 
need sViucXuAe with time, tlixoagh the 
psychological states. 

Each One Teach One , It is suggested that the understanding needed to 
develop an awareness of one's self as a person with both intentional needs 
and impulses rests in understanding the basic structure of teaching, that is, 
the necessity of helping in teaching but the impossibility of learning for 
another. Therefore, it is proposed that a Career Developwent program 
grounded in these assumptions must be designed so that one seaman teaches 
another about inter txjnal decision making. While teaching another seaman 
the teaching seaman (under the supervision of someone like a counselor) is 
learning to understand the structure of his teaching~napely , his intent to 
help another seaman become intentional* In this way, the teaching seaman 
•viil grow in his understanding of the frustration he faces in being unable 
to accomplish his supposed end gain to any marked degree. 
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In having each ^zjomn teach anothM, about 
intiLntioYiai b^vioK tht teaching 4 cowan beoJU 
the diiiicuJUiz6 po66ible ioAJUiJiz in hU 
e^^o/uU to tAoin anotheA to be intei/vUonat. 
ContMJit thi6 6AXuation [fUXh what a6uaZZy 
occju/u when decision mofctng i6 taught. 
Homatty, the bad decAJ^ion i6 recognized 06 
'6omQjJujfig the individuat should avoid; evQAy- 
thing i6 oniented towjid the good decision-- c 
tko^e that validate ou/i 6ocieXy (U it now; 6tajfuU. 
Succe^6 i{> K^An^oKced and iaiXuAe ignoxed. 
HoweveA, i^ seamen a/ie taughX to succeed in 
iaiXxxKe and to recognize that they mXl make 
bad 06 wett o6 good decUion6, then theJji 
decA^iom might improve a& they 6eek to dU- 
tingui&h thein, intentixfnaJt' needb i^vm inten- 
tionat impiJdUeJi ^h/iough 6tytt KecogniZLon. A 
beJXeA decision may be made a^teA centeAing 
on 6qZ^, lUing ouA cubiJ>tic modoZ JLnojoAponatijnjg 
the decUion-making 6kUJU to gain a knoiAitedge o^ 
decUion-^making 6tyte. 

U^e the JntentionatiXy BohavioAaZ AppAoach . Interactive decision 
making focusing on use of steps in process to recognize style could be trans 
lated into a functional framework by peer teaching. A guidance program 
could be structured to utilize seamen teaching each other in developing 
the intentional individual. The Intentionality Behavioral Approach 
developed by Ivey and Rollin (1971) may be adaptable as a means whereby 
the end gain of intentionality awareness might be achieved. 

The main objective o^ tJie ^Ivey-Hoilin 
peA^omance cu/iAicutijm 6o ^oa con6tALicted 
^ to develop the intentionat individuat, 
i.e., .one tjoho can Ac^pond ^AeoJiy and 4pon- 
tanejovubty to hi6 6aAnx)unding6 and envinonment. 
The intentional individual 6uppo6edly ha6 the. 
tool6 to genoAate attoAnate \joonZd viom 
enablUnjg him to appnoach a pAoblm iAom a 
diiizAent vantage point. He iM able to 
undcAMtand and cjonsideA oZteAnate peAception6 
0(J himeJii and otheu. The intentional 
individual constantly acts. ThU action is 
dAcuM ^Aom a uiide voAiety o^ behavioAal 
altoAnatives open to him. "In the exuiZy 
stage the individual has something mth 
u)hich to AjitcAact and in the late stage 
students con utilize constAucts in theiA 
om fashion and eventually develop thetA 
om unique mhld view and teaching style^^ 
{p. 150). 
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The, Ivay-RotLin appwack u p^ima/iltij a 
tuning appxoacli f^o^ tcachcxb. In adapting 
tlUb app^oacJi to Caieci VcvaZoprnzrvt, thz 
tJia^ining aspect tki^ p^og^am musk y^ot be 
ovcAlookcd. To CAzatQ intz\vUoYiaJi individuats 
by tnaliUng methods maij filsk tc/iot PeAti caJLls 
the. bane OjJ oua civlUzation, i.e.., thz 
cAejation o\ peA^oM "a»^/i choAacteA" but mXhout 
"4c£j{." To avoid ciioAacteA o66i^icxvtion, tnton- 
tioifU must deveZop in Aziation to a pexson^ 
understanding OjJ tliz basic 6tnacXuAZ o^ liLs 
nzQjds, nameZy thz KeZatiowship o^ Ills 6tAuctaAA.ng 

thz znviAomzfit to 6atls^y hi6 pAincUpat 
need demands. HomvzA, hz mu^t usz thz method 
dtscAibzd to txaminz tv/zat at thz momznt hz 
tHinks OAZ nzzd& and vdiat in thz long Aun OAz 
ontij imputszA. Tkis di^tinc£idn^^^impontant 
i^ m OAZ to imp^ovz dzcZsioyi 'r}akin^>^heAZ 
must be a ^zcip^ocxil aioawiiU>. ^ nzzds^a^ 
impulsc6 OA thzij ^eZatz to 5t[/^^ o^ dzclsioft 
maki}xg, and thz individual mu6t be "doing icith ^-^ 
aiMAznU6" to makz thz distinction. 

Stylz 0^ Vzcision h\aking. Style, o^ dzcyLsion 
making is onz o^ thz cAitical points in oua 
cubistic model o^ dzdsion making. Wz dz^inz 
6tylz OA thz 6tAatzgy us zd in making dzcJjsionjs. 
To A zxxmplz, does the Individual makz a quick 
"imput&ivz" decision, an "intuitive" dzclsion, 
OK a "planned" dzcLsion, etc.? We thzn 6zzk 
to liavz thz 6eaman idz>iti^y Ivis om 6tylz o^ 
dzclsion making by using thz Vhiklagz "InneA- 
Reliant" |I-R) a^id "OtheA-ReJUa^it" (0-R) 
stAotzgies. In 1969, VinkZagz dzf^inzd 
"InnzA-ReZiant" dzcidzAS ojs tho6Z to/io takz 
responsibility ^or thziA om dzdsionJS and 
thz "OtheA Reliant" ojs tho6Z who tAans^ZAAzd 
^that responsibility to 6omzonz or something 
eJLsz. Shz iound that appAoximately 42 pzAcznt 
0|J her kigh 6choot 6tadz^its wzAz "Inner-ReZiant" 
dzcidzAS. Obviously, it Is dzJSinablz to incAzasz 
thz nuittbzA 0^ "InneA Retiant" in thz population 
gznzAoUy and in thz Uavy population paAticuZoAZy , 
MoAZ spzci^ically , zach Vinfitagz 6tAatzgy Is 
as ^ollom: 

JmpuLsive dzcideA^-one u^/io takes thz f^lASt 
aJUzAnativz that Is prese^itzd. "Vzcidz now, 
think latzA." 
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Kthobxtion oi tht dzcAJblon up to tht 
(Movwmoyvt ok jjote. "What even, mil be 
be." 

Compliant dzcAjiQA--om tcho goeA olonQ tuctfi 
the p£an4 tomtom etAe i$o^ fuw, -tithcA 
than mofeeA hX6 oum deccA^owA. "I^ 
ok mXh you, lt^6 ok mXh me." 

Vztxiying decuxfcA--one who dttay^^ thoagkt 
and aoJtlon on hXA pA.ob£ew tuttct £atcA. 
n\U think about that tomoMOia.^ 

Agonizing deacdcA--one who ^pewdA macli 
tone and thought in gathznAng data and 
anatyzing aZtzJinatiyju only to gtt to^t 
amid&t tha data he hob aj(icmuZat^,d. 
Thz "I can't mafee up my moid" t{/pe. 

Planning dzddtK'—oM, who^e ^Viatzgy i^ 
ba6zd on nattonal appKoack Mith Aome 
balance betu)tm thz cogn^ctcve and emo- 
tional. "I am the captooi o^ my iJate: 
I am the moi^tvi o^ my 6ouZ.** 

Intuitive d^,cid(iA"'One, wrfio decideA on 
what he ^ee£A but cannot vcAbotcze. 
Th^ >u the ">ct ^ee£A ^ht" tt/pe. 

Vanalytic dzcJidoji—ont who accepts the 
KUpon6ibiLLty ^oK ku de,cuion but Is 
unablt to do much towatd opp^oaclioig >tt. 
The "I fenow I shooed, but I juAt can't 
get mth >ct" tt/pe. 

TheAe At^egteA oie tdentt^Jted bt/ tfee seaman 
OA "each one teach ua one" uA>twg the Ive{/-Ro££tn 
app-^oach onxmtQjd tovoa/id idmtQicatlon o^ 
dz<ii6ion-making 6tyl^,. The, htylo. l6 identiii^^d 
boAed on the actual choice mode ^ec{/ctcng timugh 
the, 6ub6tagt6 o^ zxplonatijon, cAy6talUzatix)n, 
choice, and cZoAtiicatijon [pKoblem-^olving 6tatt]. 

Remember that all the exercises involve use of a seaman's experience, 
not profiles of another's experience except in rare cases. This should not 
be threatening to the seaman as he is dealing with everyday decisions which 
do not involve exposing that which he has not already exposed by his decision, 
For example, decisions about what to do off duty, what to buy on shore 
leave to take home, and the like are what is called "low-risk and low- 
cost" decisions which oUow the seaman to learn about decision making on a 
somewhat safa basis b^fort ^'^^ has to make decisions on a high-risk, high- 
cost basis. The emphasis, tii., !ore, is oriented toward teaching the 
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individual liow to improve his decision making in the low-risk, low-cost 
ariM wliiili giMioralizes to the high-risk, high-cost area. However, there 
Ate some derisions that, legcirdlcss of how good a decision maker the 
individucil is, cannot be decided well without help. For example, in 
home buying, not very many people know to look beyond the "ginger bread" 
in ti liouse — tancy fixtures, extras that cover up defects, etc. A 
sotUnan needs to have this kind of information presented to him so that, 
when lie marries and decides he wants to own a home» he will have the know- 
ledge necessary to make a decision that best benefits him. Otherwise all 
the decision training in the world will not equip him to make that "one- 
shot" decision* It is believed that in giving the seaman experience in 
improving his decision making on those things that present themselves often 
for improvement (low risk, low cost) and in giving him information about 
those "one-shot" decisions that he makes once or twice in his life (high 
risk, high cost). Futhermore, there are some decisions that strategy does 
not improve as much as good information does. This leads to the last 
psycliological state, solution using. 

Solution-Using State: ACCOMMODATION Stage 

in this state there are no props; the individual is alone with his skills. 
However, an activity that would be appropriate in this phase is a group 
situation where seamen share what they have been experiencing, problems they 
have in "doing with awareness," the improvement they have made, and the 
excitement of discovery with themselves. It is important to allow seaman 
to share their accomplishments as well as their problems. 

The decision making from the frame of reference of the person experienc- 
ing it has been presented. All our suggested activities have their origin 
in the experience of the person — looking at what he does now to improve what 
he will do in the future. 

Tlie experiential frame of reference from the Tiedeman paradigm of 
decision making has been discussed; first, its origins in educational 
and vocational identity, then augmented by D'Haia's work in vocational 
identity. The union of identity and decision making with Ellis' ideas 
on the comprehension of one's self-deciding was then enlarged upon. In- 
corporated was Miller's use of person-to-person interaction in cefttering 
one's decision making activity in self. Finally, these five major ideas 
were integrated into the Miller-Tiedeman cubistic model of decision 
making. All this underlay the experiential framework from which was 
suggested activities inherent in the teaching of our model. 

Remember that the underlying assumption of this cubistic model is the 
same as that of Career Development — helping the person comprehend his learn- 
ing capacities and processes so that they are vibrantly actualized from 
"breath to death." If cot )rehending decision-making development becomes 
the primary aim in Career Development, renewal will occur in the Navy. 
The Ntivy hen will not just expand its ranks with seamen who will not mature 
:.iftfr enlistment as can happen if care is not taken to integrate compre- 
hension of decision-making development into its basic training ano service 
concepts. To cultivate the comprehension of style in decision*making 
development from the experiential frame that has been presented and illustrated 
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will result in centering the decision-maKing process in self. An all- 
volunteer Navy consisting of such self-motivating, self-initiatlngy and 
self-correcting seamen can be an effective force for world peace and 
development • 

The several riotous and rebellious events of the past decade suggests 
what should have been obvious before their occurrence. Dissatisfaction 
does not go away; it goes elsewhere. When dissatisfaction is great y it 
explodes. The Navy largely enlists individuals in their late adolescence 
and/or young adulthood. A program of Career Development is essential to 
further personal and self development and responsibility. The program 
that has been outlined in the previous section will have the desired and 
needed effect if the Navy will in its wisdom Just understand the considex;r 
able need for introduction of more discretionary options into the career 
development of its enlisted personnel and also raise the frequency with 
which enlarged options can be chosen. The self-Iirected self needs support 
of an environment in which actual individual discretion is frequently 
possible and in which accountability for individual responsibility is 
invariably expected and facilitated. 

A potential scientific dividend inheres in this proposal in addition 
to the personal and social or service dividends already discussed. A 
framework within which self development can take place within progressive 
career development has been described. The described adjutant framework 
is the needed framework. In this framework, the individual participates 
with the helper or scientist in the analysis and development of his self 
concept through the intentionality concepts of review, feedforward, and 
feedback. Science demands that this process ultimately pass to the scien- 
tists* hands for description and repeated objectif ication. The individual 
can participate in this process for awhile at its start as Tiedeman (1970) 
argues. The newly introduced concept is that of collaborative, not unilateral 
decision making about self concept. In the collaborative concept it is 
necessary tc delineate the collaborative content and procedure as well as 
antecedents and consequents. Other papers offer a fair start toward 
definition of the needed collaborative content. This paper elaborates 
the needed collaborative procedure. What stands ahead as challenge is both 
more explicit definition of the desired end state and delineation of the 
developmental process in progressive hierarchical self development in 
association with comprehension of decision making development. 

In 1969, when refunding of the Information System tor Vocational 
Decisions was under consideration, Tiedeman and others proposed that the 
completed System would in effect be the laboratory in which developmental 
comprehension of the phenomenon of epigenesis in decision making development 
can be objectified and understood scientifically. Although that earlier 
proposal failed of support, it is considered that the proposal is the most 
valid one for study of the phenomenon under consideration here. Study requires 
a laboratory in which decisions can take place repeatedly, prior conceptuali- 
zations and expectations are available, review and reconceptualization can 
occur, and new goals and feedback procedures can be defined and used. 
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riio Information System for Vocational Decisions was such a system. The 
Navy Personnel Research and Development Center could turn the procedu.re out- 
lined in the previous section into a similar system without benefit or 
disadvantage of computer by introducing appropriate personally and Center 
kept records of repeated individual decision making. Such a program of 
research could have great service, societal, and scientific advantage. 
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A THEORETICAL MODEL 



Abraham K« Korman 



The theoretical innovation that has marked the study of behavior 
in the world of work over the past ten or fifteen years has been and 
continue to remain great, even for the most casual onlooker* Theore*- 
tical ideas have been brought forth and suggested in many different 
areas and, what is even more significant, research has been generated 
that has enabled the researchers to learn much about the nature of work 
behavior and the personal, technical and social factors which influence 
it in all its variations « 

It is clear, however, that if these theories are to be useful and 
are to serve adequately in their primary function of stimulating new 
thoughts, new research and new techniques of practice, they need to be 
looked at periodically and evaluated as to the evidence that has accu- 
mulated relating to them* Such periodic visits should tell us 
whether the ideas proposed, and the predictions which stem from them, 
are still viable or whether some new framework is called for. Even- 
tually, all theories come up wanting and a new framework comes to the 
fore. Hence, a continuing responsibility of the theorist is to keep 
examining his own work and to initiate changes in his conceptulization 
as new data becomes available. 

The goals' of this paper are basically two in nature. First, a 
brief review will be made of an hypothesis of work behavior which was 
proposed by the author some time ago (Korman, 1970, 1971) and the 
research which was directly stimulated by this hypothjcsis subsequent 
to its publication. Following this, an extension of this model will be 
proposed in order to overcome a since recognized lack in the original 
proposal. 

The Original Hvpo thesis and Some Consequent Evidence 

The original hypothesis suggested was actually formulated in two 
complementary papers, the basic frameworks of which are reproduced here 
in model form as Figures 1 & 2. The rationale underlying these two 
figures was originally stated as follows: 

\ 

Thus, the following hypothesis is offered as to the nature of work 
behavior: All other things being equal, individuals will engage in and 
find satisfying those behavioral roles which will maximize their sense 
of cognitive balance or consistency. ? 

This being the case, the following two derivations would be implied: 

1. Individuals will be motivated to perform on a task or job in 
a manner which is consistent with the self-image with which 



137 



11-4.1 



u 

i 

O 

u 
« 

M 

(A 

(d 

H 






m 






Q> 






00 




4J 


1 


cd c 


c 




(0 


0 




•H 

>> 




a> 
1 


0) 


U 4J o 


«M 






0) 


•H U 


0) 






4J 




•H 




a> 


(0 


^ f-H Cd 


4J 




(0 


0) 


iH 


Cd 






1 


o cd (0 


(0 




u 




4J M cd 


t 






iH 


Q> 








a> 


4J C ^ 


Q> 


•H 


-H 




C Q> iH 


Q> 


Cd 


U 




0) 00 Q> 


C 




Q> 


u 


4J (0 




T3 


Ou 


•H 


X C 0 


4J 




0) 


C 


0) O -H 


c 


> 


1 


o 


0) 


Q> 










4J 


T3 


tr 




JC Q> 


Q> 


C 


id 


o 


4J Ou O 


Ou-H 


H 



u 
c 

0) 



ERIC 





• * 


(0 


o 


ce 


an 


c 


e 






0 


o 


•H 






u 


c 


0) 




Ou 


•H 




Cd 


o 






u 




o 


% 


(0 






4J 




Cd 




4J 


% 


.f-l 




•H 






Cd 


U 


§ 


Cd 










4J 


0) 


Cd 




N 


Cd 












u 


00 •H 


U 




o 





(0 

00 Q> 
C U 

s 

Cd c 

^ 0) 

4J 

CO O 

Cd .H 
>» 

SO) 
0) 

O "H 

O ,H 
O 

U 

iH 4J 
JC C 

§ 

O Cu< 

u o 

4J 0) 

C > 
X 



o 



.8 



D. O ^ 
0 "H ^ 

" c 
a> 

o u 
00 M a> 

0) ^ 

- O 13 

0) 

0) oou^ 

4J C O 



(0 



c 
• o 

00 -H 
C U 
•H cd 



c 
o 



U 4. 

(U O X 
C I 00 



cx 

(0 0) 

0) o 

M u 

3 cd 

O 00 

M *<-( 




c 
o 

CO 0) o 

J-« 0) ?: 

0) c 

D. :) ^ 

o o 

cd o 1-1 



: c 

c ^ 
B 

C U 

CO cd 

cd u 



o 

Cd • 

^ (ft 
no 

^ o 

o u 

4J 0) 

0) o 



o ii 

•H C 

o o 
a. u 



00 














c 










0) 












U 


o 




o 




> 




•H 






an 


1 




CO 


0) 


o 




o 


4J 


0) 










00 


U 


4J 


4J 






C 


0) 


o 


Cd 




00 1-4 


0) 




CU 


c 


u 


c 


O 


1 


an 








u 


o 




•a 


> 


0) 


4J 


00 




CO 




o 




c 




4J 


1 


o 






o 






o 




.H 


d 


u 


u 




00 




O 


Cd 




0) 


0) 


0) 


CO 


U 












4J 


4J 


Cd 


Cd 


4J 


CO 


00 


c 




c 


0) 


Cd 




c 


o 






•H 






•H 


u 


0) 


0) 








4J 






4J 




(0 


• 


4J 


•H 


4J 


X 


o 


0) 


00 


0) 


Cd 


Cd 


0) 




4J 


• 


•H 


e 






x: 


Cd 


0) 






o 




c 




C 


0) 


4J 


4J 








•H 


4J 


c 




0 




00 




c 






4J 




a 


CO 








O 




















00 




U 


c 


•§ 


Cd 


0) 


c 


u 


u 


0) 






•H 


vl 




Cd 






UH 


fH 










0) 


0) 


Cd 


•8 


o 




O 










u 




0) 0) fH 

d u cd 

•H ^ C 

-I 3 ^< 

4J O 3 

3 O 

6 w 1-5 



dO 



138 



o 



I 

o 

M 
H 

O 



a 

01 
>% 

m 

01 



c 
a» 

44 

9) 
-H 
CO 

c 
o 
u 

85 

O C 
U M 
44 10 

:) (U 

0 iH 

•ad TJ 

01 c 

01 

O U 
U C 
01 



01 

o» 



-H C 

» g 

0» C 

u o 

a u 

0» «H 

X > 
C 

u o 
o 

» g 

•H W 

Xi O 

« C 

u :) 

« (0 

M 0) 
0) 

0> (0 
0) 



o 

44 



0» 



ERIC 



•a w 

0) >s 

44 0) 

CO 

> <M 

•H 0) 

44 ^ 
O 

0 0> 

(0 



II 



U 
O 



0> 
M 

U 

£ 

0) 
44 

c 



c 

s 



c 

0) 
0) 



0) 

u 
c 

0) 
01 
6 

o 

u 



>4 

o 

•H 

% 

0) 



T T- 

44 0» > 

•o c o 

M (Q 09 
CO J= 

3 u a 

O : 0) 

44 rH 

44 c 0) r o 

C O >-i (0 C ^ 

S-H 01 3 O 0« 

09 J3 O -H U 

0) 09 44 44 44 0) O 

> 0» O CO > t4 

0» H ^ ^ > 

•H 00 'O 44 M 44 (0 
JS op C ^ fO CO 43 

U CO ^ iH > 0) 0» 

CO -H ; >-i ^ 

J3 44 O 

O 0> O C O C 

33 0) X (0 SS (0 



09 
CO 



c 

I, 




M 0) 0) 
CU CU CO 




01 



a 

o 



& 

00 

c 

« 

o 
a 



S 



8*^ a s 

•H • O -H 

S - J3 



6 t/i 



o 



o 
u 

c 

o 
u 



CO 

•s 

CO 

0) o 

% 



I 



o 



0) 
01 



•O 44 



a •H 

u 
CO 

M (44 
00 O 

o 

n c 

Ok o 



a u 

q o 

*r4 ctf 



•HUN 
B U •H 



CO M-i 
N O 

>% 
44 



0) -H 
01 CO 



g4J > |4 
CO Q CO 
N M > 



II-4.3 



! I T 



139 



they approach the task or job situation. That is, to the 
extent that their self-concept concerning the job tas'*^ 
situation requires effective performance in order to result 
in "consistent" cognitions, then, to that extent, tht^ will 
be motivated to engage in effective performance. 

2, Individuals will tend to choose and find most satisfying 
those job and task roles which are consistent with their 
self-cognitions. Thus, to the extent chat an individual 
has a self-cognition of himself as a competent, need-satis- 
fying individual, then, to thatNextent, he will choose and 
find most satisfying those situations which are in balance 
with these self-perceptxons . (Korman, 1970) 

Underlying this hypothesis were the following assumptions: 

For purposes of this hypothesis, the author assumes that one's 
self-esteem or self-evaluation is the extent to which he sees himself 
as a competent, need-satisfying individual. Differences in such self- 
evaluation may arise, for our purposes, in a nuiri}er of ways, first a 
relatively chronic level of self-esteem may be conceived; that is,, a 
relatively persistent personality trait that occurs relatively consis- 
tently across various situations, Secbdd, one's self-perceived compe- 
tence may be conceived as concerning a particular task or job at liand. 
This may arise as a result of differential learning experiences or the 
specific characteristics of the moment. Finally, one's self-esteem is 
also a function of*the expectations vhlch others have of us... to the 
extent that others (a) think that we are competent and need-satisfying 
and able, and (b) exhibit such thoughts by their behavior toward us, 
to the extent our self-perceived competence concerning the task at 
hand is increased and so is, predictably, task performance. The 
rationale for this is that such Interpersonal evaluation provides a 
base of "reality" which we learn from our previous experience,.. 

As support for this statement, a number of research studies con- 
duct* by the author were published. In addition, an effort was also 
made to show how these conceptualizations were consistent with the work 
of others. 

Since the time of original statement of these proposals, a nund)er 
of studies have appeared which were either /Urectly stimulated by the 
hypothesis or are directly relevant to it. These studies have been 
reviewed and their results are summarizecl in Table I. 

An examination of these findings shows a score card of eleven 
studies showing support for the hypothesis, three showing mixed support 
and one showing no support whatsoever, , While one hesita^res to draw firm 
conclusions about anything with which one has been. personally identified, 
and certainly when concerned with only 15 studies, it seems justified 
at this point to suggest that che original hypothesis still seems to be 



1^9 

140 



11-4.4 



reasonably viable. Thus, even If one takes the problems of "Esqperlmenter 
demand" In mind as a possible contaminant, this positive evaluation still 
appears warranted since: 

a) the author had no knowledge of twelve of the studies 
until they were completed and became known to him; 

b) the author served as doctoral dissertation advisor 
on one; 

cX the author was personally involved in only two of the 
studies. 

^ A Theoretical Extension 

Given the findings, then, of Table I, and what also seems to be a 
relative lack of experimenter contamination, the oversdl logic of the 
hypothesis continues to remain useful. Yet, there is a problem with the 
.framework and that is its prediction that the good get better and the 
poor get worse, with these effects increasing overtime* In other words, 
the model predicts that people, once they achieve success with their 
careers, will become increasingly successful, while those who have a 
failure experience will become increasingly unsuccessful. However, it 
is cleaiT that there is something that is wrong with this conception. Not 
all succe^ssful people become increasingly successful and not all failures 
remain failures. Sometimes, people who were once achievement'oriented 
become "less so", and those who were once non*achieving become achievers. 
The question is "why"? Why these differentiated responses to success and 
failure? Can we ascertain the types of conditions or factors which lead 
to oi determine these differing behaviors? One obvious value of being 
able to do, this would be that we would then be able to deal with and, 
hopefully, control and influence both those factors leading to the 
decline of career effectiveness, once success has been attained, and those 
factors which lead a person to respond constructively to. failure* 

Since it is clear that the hypothesis, as originally developed, can- 
not account for these processes, some type of change is necessary. However, 
one consideration is that the extension should not, at this time, alter 
the logic of the original hypothesis and its basic predictions because of 
its (the hypothesis) continuing viability, as we have indicated above « In 
Figure 3 is presented such theoretical extension, one designed to account 
for thc3C phenomena. Basically, what is proposed in Figure 3 is as follows: 

a) In general, high self*-'esteem leads to career success and 
low self-esteem leads to career failure; (however, these 
predictions are not perfect and on occasion, high self- 
' esteem people can fail and low self-esteem people can 

succeed; these statistically less likely outcomes are 
shown in Figure 3 as broken lines) ; a major outcome of 
success or failure is the engaging in of psychological 
attribution processes that involve cognitive and 
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attitudinal re*evaluations of Che conditions under 
which success or failure takes place* The contei^ts 
of the attribution processes which take place are a 
function of the cultural and organizational values 
to which the person is exposed at the time, with 
these attributions hypothesized to occur as follows: 

Condition I - b) When the cultural and/or organizational environment 
emphasizes hierarcUal values, material rewards, and 
external control, and career success has occurred, the 
leaders who helped in the career success (e.g. parents, 
teachers, managers, etc.) and who dispensed rewards as 
a lesult of this success, tend to become valued. This 
positive evaluation of these leadership figures gra- 
dually becomes independent of the original reasons for 
the attitude and the rewards they originally dispensed 
and leads to the growth of attitudes and values favoring 
hierarchal systems of authority. These attitudes are 
then predicted to lead to career failure, primarily 
because of the low self-esteem such hierarchy-favoring 
attitudes lead to (although high self-esteem can as we 
have 3aid, evidence career failure also* These statis- 
tically less-often occurring behaviors are shown in 
Figure 3 as broken lines.) 

Condition 11 - c) vJhen career failure occurs and outcomes sink below a 
level of satisfaction below thaL deemed appropriate 
for a low self-esteem person, and when the cultural 
environment (or organization) , encourages non-'hierar- 
chal thinking, intrinsic work values and beliefs in 
^ internal control of behavior, it is predicted that 

there will be a rejection of the hierarchal attitudes 
that lead to low self-esteem and the increased likeli- 
hood of low outcomes. This rejection of hierarchy will 
lead to a higher valuation of self and the eventual 
engaging in of behaviors which would be appropriate to 
achieving career success. 

Condition Ill- d) Finally, it is hypothesized that when the environmental 
conditions are opposite to those specified above, the 
opposite results occur, i.e. the successful become more 
so. Overall, then, the process being Hypothesized is 
one where it is suggested that, sometimes, success breeds 
success, and sometimes, it breeds failure. Similarly, 
failure sometimes breeds failure, and, sometimes, success. 
In this way, it is proposed that we may be able to account 
for the general observation with which we started this 
discussion, i.e. the fact that, son^times, successful 
people become unsuccessful and, sometimes, unsuccessful 
people become successful. 
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There are at least two major questions which arise in relation to 
the proposed framework. The first concerns? the degree of specific 
evidence for the processes being suggested. Secondly, there is a problem 
in that we are proposing a contingency model here and, as we have said' 
elsewhere (Korman, 1973a), contingency models are extremely difficult to 
test in empirical research. 

For the first question, there are, as yet, no specific longitudinal 
tests of the model, as proposed, but several are in the planning stage 
and will be undertaken. One form of evidence that may be worth citing is 
that the model, as proposed, is consistent with a number of studies in 
the literature. These studies, which we have sumoiarized in Table 2 were 
conducted within different frameworks than the on^we have proposed here, 
but their findings are consistent with our general theme. However, des- 
pite this consistency, this type of evidence is only minimally satisfac- 
tory at best. Clearly, research studies stemming from and testing the 
longitudinal predictions of the model is necessary. 

A second problem is that we are talking about a contingency model 
and these are very difficult to test (cf. Korman, 1973a) if contingency 
effects are predicted "a priori". The problem here is that such "a 
priori" tests assume knowledge of parameter values which make a test 
appropriate, a very difficult proposition. One way of overcoming this 
difficulty is to treat the contingency variable as an independent 
variable and then predict linear effects (such as the differential 
attributions we have hypothesized here) (Korman, 1973b) • Other proce- 
dures are also possible, but the point is, difficult or not, if a 
contingency theory is necessary, then this is what needs to be developed. 
It is, then, up to our ingenuity to find a way of testing tne theory, a 
challenge which we will attempt to meet in the research we will be 
designing in the future relative to the framework we have presented here. 
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Table I - Summary of Studies Relevent to Predictions from 
Korman Consistency Hypothesis of Work Behavior 



Summ<iry of Research 

1) College seniors actively seeking 
employment rated potential 
employers on same semantic 
differential instrument on which 
they had rated the self. 
Generally » support was found for 
the predictions that high self- 
esteem individuals would tend to 
implement their self-concept in 
choice of employe rs\ those with 
low se) f-esteem would complement 
r.heLr self-concept, and those 
intermediate in self-esteem would 
do neither consistently. 

2) Tlie prediction was made and sup- 
ported that persons high in self- 
esteem more often made second 
vocational choices that are con- 
sistent! with their personality 
styles and persons low in self- 
esteem made second choices that 
are consistent about as often as 
choices that are inconsistent* 

3) The prediction was made and sup- 
ported that there would be a 
positive correlation between mea- 
sured self-esteem and congruence 
between description of self and- 
description of chosen occupation, 

4) The prediction was made and ex- 
perimentally supported that high 
.>elf'-esteem individuals would be 
made anxious by failure and the 
low self-esteem person would be 
made anxious by success. 



Ir vestigation 

Behling & 
Tolliver (1972) 



Implicatior*; for 
Korman Hypothesis 

Supports Hypothesis 



R. Leonard^ Walsh 
& Osipow (1972) 



Supports Hypothesis 



^reenhaus (1971) Supports Hyx»othesis 



Cohen (1971) 



Supports Hypothesis 
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3) The prediction was made and sup- 
ported that success in task per- 
formance would predict satisfac- 
tion for high self-esteem indi- 
viduals, but not for low. How- 
ever, satisfaction did not 
dif ferenticlly predict perfor- 
mance* 



Siegel & Bowen 
(19 71) 



Mixed Support for 
Hypothesis 



6) Ihe prediction was made but not 
supported in an experiment that 
success in task performance would 
predict satisfaction for high 
self-esteem individuals^ but not 
for low, 

7) Individuals of high personal sta- 
b*iiity and integration were more 
likely to have made college major 
choices congiruent with their per- 
sonal characteristics than those 
with low levels of personal sta- 
bility and integration, 

8) Experimentally manipulated task- 
specific self-esteem signifi- 
cally predicted task perfonn^nce. 
Socially influenced self-esteem 
predicted task performance for 
high autho ri tat ions ^ but not for 
low- Chronic self-esteem did not 
predicu performance in this 
experiment. 



Leonard S, & Does not support 
Weitz^ J. (1971) Hypothesis 



Walsh & Lewis 
(1972) 



Supports Hypothesis 



Greenhaus & 
Badin (1973) 



Mixed support for 
Hypothesis 



9) The length of tenure in a high 
self-esteem inducing work envi- 
ronment (i.e. implying low 
hierachy^ low routinization and 
low control by others) was found 
to be positively correlated with 
the degree to which these types 
of environment were positively 
correlated with achievement- 
orientated work attitudes and 
general work effectiveness* 



Gavin Green- 
hous & Korman 
(1973) 



Support for 
Hypothesis 
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10) Individuals with chronic low 
self-esteem are made uncom^* 
fortable by success and avoid 
further success when (a) they 
are convinced by their low 
self-esteem and (b) they are 
made to feel personally res- 
ponsible for their behavior. 
When these conditions , are not 
true^ the negative efforts of 
low self-esteem do not occur. 



Maracek and 
Mattee (1972) 



Mixed support for 
Hypothesis 



11) Individuals who expect failure 
in the future are more likely 
to reject success when it occurs 
than individuals who do not 
expect failure in the future. 



Mattee (1971) Supports Hypothesis 



12) Nations who were classified as 

high in achievement by McClelland 
(1961) were classified as low in 
aggression by Fieraband & Fieraband 
(1970) and Nations classified as 
low in achievement were classified 
as high in aggression. 



Korman (1973c) Supports Hypothesis 



13) 



1 A \ 



Performance predicted satisfac- Badin & Green- Supports Hypothesis 
tion for high self-esteem but haus (1973) 

not for those with low self-esteem. 
Satisfaction predicted performance 
for low self-esteera but not fot high. 



Congruence between self-percep- 
tion and perception of chosen 
occupation was greater for those 
with high self-esteem than for 
those with low self-esteera. 



Healey (1973) Supports Hypothesis 



15) High self-esteem interviewers 
are more favorably impressed 
with aoplicants with similar 
attitudes than with dissimilar 
applicants. For low self-esteem 
interviewers the relationship is 
reversed such that dissimilar 
applicants are more favorably 
evaluated than those with similar 
attitudes. 



Leonard (1973) Support Hypothesis 
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Table II - Summary of Evidence Relating to Proposal Model 



1) Low Self-esteem Ss who deny a 
social manipulation aimed at 
inducing low self-esteem do 
better at a later task than 
those low self-esteem Ss who 

did t\ot protest the manipulation* 

2) Low self-esteem boys who were 
held in high esteem by their peers 
and teachers had a greater achieve- 
ment and self-improvement motiva- 
tion than those low self-esteem 
boys who did not have high ratings 
from their peers and teachers. 

!») Individuals who believe in 

Internal (personal) Control of 
Behavior expend more effort on 
similar tasks subsequent to 
failure than do those who be- 
lieve in External Control. 

4) Individuals from backgrounds en- 
couraging belief in control over 
ones life react more construc- 
tively to stress situations than do 
those coming from backgrounds 
encouraging powerlessness. 

3) individuals who h;?ve performed 
tasks for money are less likely to 
perform tasks in the future when 
money is withdrawn than those who 
have not~perTonned tasks for money 
in the past* 



Pepitone^ Faucheaux^ Moscovici, 
Cesa Bianchiy Magistretti, and 
lacono (1969) 



Coopersmith (1967) 



Weiss and Sherman (1973) 



Tiffany & Tiffany (1973) 



Deci (1972) 



6) The more hlerarclial a society (in Bass and Franke (1972) 
terms of economic inequality) , the 
more members of that society will 
endorse approaches to leadership 
that involve mistrust of individuals 
and the need to manipulate them in a 
political manner. 
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Table II - Summary of Evidence Relating to Proposal Model 



1) Low Self-esteem Ss who deny a 
social manipulation aimed at 
inducing low self-esteem do 
better at a later task than 
those low self-esteem Ss who 

did not protest the manipulation. 

2) Low self-esteem boys who were 
held in high esteem by their peers 
and teachers had a greater achieve- 
ment and self-improvement motiva- 
tion than those low self-esteem 
boys who did not have high ratir.gs 
from their peers and teachers* 



Pepitone, Faucheaux, MDscovici, 
Cesa Bianchi, Magistretti, and 
lacono (1969) 



Coopersmith (1967) 



3) Individuals who believe in 

Internal (personal) Control of 
Behavior expend more effort on 
similar tasks subsequent to 
failure than do those who be- 
lieve in External Control. 



Weiss and Sherman (1973) 



4) Individuals from backgrounds en- Tiffany & Tiffany (1973) 
couraging belief in control over 

ones life react more construc- 
tively to stress situations than do ^ 
those coming from backgrounds 
encouraging powerlessness « 

5) Individuals who have performed Deci (1972) 
tasks for money are less likely to 

perform tasks in the future when 
money is withdrawn than those who 
have not performed tasks for money 
in the past. 

6) The more hierarchal a society (in Bass and Franke (1972) 
terms of economic inequality), the 

more members of that society will 
endorse approaches to leadership 
that involve mistrust of individuals 
and the need to manipulate them in a 
political manner. 
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PERSONAL VALUE SYSTEMS OF MANAGERS AND ADMINISTRATORS 
George W* England 



During the past six years, several of the researchers at the Indus- 
trial Relations Center have developed an approach to the study of personal 
value systems of managers and administrators.! To date the following 
Values have been assessed: (a) 3,000 managers from the U.S.A., Japan, 
Korea, India and Australia; (b) 500 U.S. college students; (c) 200 U.S. 
educitional administrators; (d) 300 U.S. Naval officers; and (e) 136 U.S. 
labor leaders. While there has been a number of publications of journal 
ariic les, research monographs and technical reports on the approach and 
lindings, it seems appropriate to present a brief summary of the approach, 
results and possible implications of this work. Undoubtedly there are 
opinions biased toward overestimating the importance of the work but 
a sincere effort to be realistic has been made. What was really found and 
whit does it all mean? 

5 

Ralionale ioi the Stud!^es 

A framework was developed to delineate the relationship of values to 
behavior for managers and wa3 subsequently utilized in the development of 
a measurement approach to personal value systems that (1) was responsive 
to relevant theoretical and definitional notions of contemporary value 
theocy, (2) was designed in light of the characteristics of the group being 
studied (mraagers), and (3) was clearly cognizant of the primary importance 
of the behavioral relevance and significance of values. 

Several major classes of overlapping values are recognized in the frame- 
work. All possible values which might be held by an individual or by a 
spocitic group constitute the total value space and are known as potential 
values. The potential values are made up of two classes of values: nou- 
relevant or weak values for a specific group or individual (those, which 
wcHild have little or no impact on behavior) and conceived values (those 
whicli are likely to be translated from the intentional state into behavior)^,. 
Conceived values are made up r)f operative values (those which have a rela- 
tTveiyTigh probability of beic^g translated from the intentional state into 
actual behavior, intended values (those which are viewed as important but 
m.iy have only a moderate probability of being translated from the intentional 
staLe into behavior because of situational factors), and adopted values 
(those which are less a part of the personality structure of the individual 
and affect behavior largely because of situational factors). 
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Values 


or weak 
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Operative 




Values 


a specific 




group or 






Intended 


individual 


Values 



Conceived 
Values 



The development of the Personal Values Questionnaire (PVQ) was based 
on the rationale that the meanings attached by an individual to a carefully 
specified set of concepts will provide a useful description of his personal 
value system, which may in turn be related to his behavior in systematic 
ways. This attempt to describe an individual's values through the use of 
a carefully specified set of concepts was influenced by the work of Charles 
Osgood and his associates and represents an adaptation of cheir methodology. 

In order to specify a set of concepts relevant to the personal value 
systems of managers, a pool of 200 concepts was selected from literature 
dealing with organizations and with individual and group behavior. In addition, 
ideological and philosophical concepts were included to represent major belief 
systems. A panel of expert judges reduced this pool to a set of 96 concepts, 
which was furthe»- reduced to 66 concepts based oir pilot studies. To provide 
\ framework within which respondents could conveniently evaluate each concept, 
the concepts were categorized into five classes: goals of business organ- 
izations, personal goals of individuals, groups of people and institutions, 
ideas associated with people, and ideas about general topics. 

In the PVQ for managers, four scales are used tojrepresent two modes 
of valuation. Since the general value of an object or idea to an individual 
is thought to be largely a function of its degree of importance to him, the 
primary or power mode of valuation utilized is the importance scale, which 
consists of three points — high, average, knd low. Because of the emphasis 
on the behavioral effect of values, it was deemed necessary to make opera- 
tional the theoretical distinction between the intentionality of values and 
their translation into h avior (operative values from among conceived values). ' 
To the extent that it is possible to determine a consistent rationale as 
to why an individual or a specific group* thinks certain concepts are important 
or unimportant, one has a reasonable basis for distinguishing operative from 
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among conceived values. In this< process , three secondary modes of valuation 
were developed trom the literature. The pragmatic mode of valuation suggests 
tint an individual lias an evaluative fra«iework that is primarily guided by 
suetess-failure considerations; will a certain course of action work or not, 
huw successful or unsuccessful is it apt to be. The pragmatic mod^ of valu- 
ation runs throughout much of the litq^rature dealing with managers and finds 
support in various analyses ^ f the Allport-Vernon Study' of Values wThich 
suggest a major dimension of values as being "pragmatic and utilitarian" 
or the finding of a major value factor being "idealism vs. practicality". 

The ethical-moral mode of valuation implies an evaluative framework con- 
sisting of ethical considerations influencing behavior toward actions and 
decisions which are judged to be "right" and away from those judged to be 
"wrong*\ The existence of a moralistic-ethical orientation is at the very 
heart ot most religious belief systems and is supported by analyses of the 
S::udy of Values which find value dimensions or factors such as "social and 
altruistic" and "idealism". 

The affect or feeling mode of valuation suggests an evaluative frame- 
work which is guided by hedonism; one behaves in ways that increase pleasure 
and decrease pain. The affective component of values has an extensive 
philosophical and psychological background and seemed important to include 
as an orientation in the present studies. 

In the PVQ, the pragmatic mode of valuation is represented by a "success- 
ful" scale; the ethical-moral mode of valuation is obtained through a "right" 
si-ale; and the affect or feeling mode of valuation is measured through use 
of a '^pleasr-'at" scale. 

A combination of primary and secondary modes of valuation was thought 
to be a better behavioral predictor than would either mode alone. For 
rxample, if Manager A is generally pragmatically oriented (i.e., concepts 
which were important to him were also seen as being successful as opposed 
to right or pleasant), his behavior would be predicteid best by viewing it as 
a joint function of those concepts he thought were important and successful . 
In a more general sense, what is being suggested is that an individual's 
behavior (insofar as it is influenced by his personal values) is best ex- 
plained by utilizing both those things he considers important and his per- 
sonal primary orientation. Symbolically, one could say: 

B ,f(inPO)^ 

V ' c 

Tliis expression would be read: the behavior of an individual, insofar as 
behavior is a function of values, is best indicated by the joint function 
of those concepts he considers important andr.which fit his primary orientation. 
For A pragmatically oriented individual, behavior is best indicated by those 
concepts considered important and successful; for a morally-ethically 
oriented individual, behavior is best predicted by those concepts considered 
important and right; whil<^ for an affect oriented individual, behavior is 
best predicted by those concepts considered important and pleasant. 
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Hi is, then, is the general rationale for the studies reported. The 
starting point is the individual manager in a work organization; the 
interest is in his values and what is told about his work behavior and 
outcomes of this behavior. This is not a study of organizations, indus- 
tries, nations or cultures although each manager in our studies certainly 
can be placed within these broader frames of reference. It is apparent, 
however, that the individual results must be aggregated to focus on many 
questions of interest. 

Sun»mary of Study Results 

!• There are large individual differences in personal values within 
every group studied. Among managers in each country, for example, some 
have a pragmatic orientation (they view ideas and concepts in terms of 
whether or not they work or are successful), some have an ethical-moral 
orientation (they view ideas in terms of being right or wrong), while some 
have an affect or feeling orientation (they view ideas in terms of whether 
or not they are pleasant). Some managers have a very small set of values 
while others have a large set and seem to be influenced by many strongly 
held values. The important values of some managers include concepts 
which are almost solely related to their organizational life while other 
managers include a wide range of personal and philosophical concepts among 
their important values. Some managers have what might be termed individual- 
istic values as opposed to group-oriented values. Some managers are highly 
achievement-oriented as opposed to others who value status and position 
more highly. Finally, it is clear that sotae managers have a personal value 
system that might be characterized as "hard". Their important values 
include concepts such as Ambition, Obedience » Aggressiveness, Achievement, 
Success, Competition, Risk and Force, Other managers have value systems 
that are often characterized as "soft" and include such concepts as Loyalty, 
Trust, Cooperation, Compassion, Tolerance, Employee Welfare, Social Welfare 
and Religion. Personal value systems, then, are like most other human 
characteristics; individuals differ greatly with respect to them. 

2. Personal value systems of managers are relatively stable and do 
not change rapidly. In 1966, the personal value systems of a national 
sample of U. S. managers was measured. In 1972, Professors Edward Lusk 
and Bruce Oliver of the University of Pennsylvania Wharton School repeated 
the earlier study on a comparable national sample of U« S. managers. They 
reasoned that the widespread airing of environmental and social issues 
(e.g.* pollution, the Vietnam War, life style changes, changing expectation 
of the labor force, and minority and disadvantaged group employment problems) 
between 1966 and 1972 would be accompanied by changes in the value systems 
of managers. The differences between the value systems of che 1966 sample 
and the 1972 sample of managers were very small* Over all 66 concepts 
in the value instrument, the average difference in value importance was 
only 3,3 percentage points between tht* two time periods. A difference of 
ten per cent or greater between the two samples was found on only four of 
66 concepts. The 1972 sample placed (^reator viluc on tho concepts Cdignity, 
trust and change) and lower value on tlie ( onuept (my boss) as compared to 



the i9b6 sample. Thest results show quite clearly tliat the personal value 
svstoms of 1972 managers are very similar Co those of 1966 managers. Per- 
son il value systems of managerial groups do not change rapidly even during 
periods of environmental and social flux. A probable explanation for 
ihi-: stability would involve the nature of the selection and developmental 
process managers go through, the requirements and constraints that the job 
ot managing places upon managers and the fact that personal values are a 
relatively stable human characteristic. 

3. Personal value systems of managers are related to and/or influence 
the way managers behave on the job. While several of the studies show this 
to be the case, the clearest evidence emerges in the study of Indian managers. 
Here the personal ''values of each manager was assessed and his behavior was 
me.isured on five job incidents, each representing a typical problem which 
a manager mighc encounter in the performance of his job. Prior to analyzing 
the data, 25 predictions were made about how managers with certain values 
would be expected to behave. Examples of these predictions are: (a) managers 
who have profit maximization as an important goal will be less willing to 
spend money on cafeteria and rest room facility improvements than will managers 
who do not have profit maximization as an important value, (b) managers 
tor whom compassion is an important value would be less willing to obtain 
research and development funds by depriving employees of part of a potential 
wage increase than would managers for whom compassion is not an important 
value, and (c) managers for whom cooperation is an important value would 
promote individual B to be their assistant more than would managers for whom 
cooperation is not an important value given the following choices — 

Individual A is a very creative man who has been constantly making 
suggestions for improvement in office procedures. Although all 
his ideas are not practical ones, you have in the past, adopted 
some of his suggestions. A is sincere and hard working, and he 
can be very helpful to others if he i*= asked for his help. He 
is, however, not a very popular man in the department, because 
other employees do not like procedural changes and extra pressures 
which they think are unnecessary at times. 

Individual B, equally efficient as A, is not a man of ideas. He, 
on the other hand, is a very congenial and well liked person. He 
goes out of the way to help othei*? whenever they have problems 
and is definitely conLributing to the good morale of your depart- 
ment, lie enjoys the reputation of a kind man. 

Across all t xve incidents, 19 out of 25 predictions are supported by the 
a.ita. These results offer strong support for the contention that values are 
niatta to behavior in meaningful wdys for managers. The fact that the 
ri' lai ionsuips exist within a sample of managers from many different organi- 
/.ttions all across India and from managers with varied organizational and 
pi t ,on.ii backgrounds is clear evidence of the role of personal values in 
.ntluoncing problem solving and decision making behavior. Personal values 
irt- i t-rtainly important in understanding and predicting the behavior of 
m ina>;ers . 
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4. Personal value s7stems of managers are related to their career 
success as managers. Career success or personal success is defined in 
terms of managerial pay relative to the manager's age in the studies of 
American, Japanese, Indian and Australian managers. It was judged that 
the heterogeneous nature of the samples dictated that success be measured 
in terms ut objective data that were relatively easy to collect. Relative 
salary level for ofie's age group provided sach a measure which was sufficiently 
accurate. Then a value profile key or pattern that was related to success in 
each of the four countries was developed and cross-validated. -The value 
patterns that were relate*., to success were similar in le four countries 
and correlated with success as follows: U.S.A. (.32), Australia (.47), 
India (.35), and Japan (.26). These correlations are of similar magnitude 
to the validity coefficients generally reported for predictir.^ •sanager 
success by other types of predictors. These results were viewed as solid 
evidence that value patterns and success are meaningfully related in a 
similar fashion across the four countries. 

Viewing the value-success relationships of American managers provides 
the following picture. Successful managers favor pragmatic, dynamic, 
achievement oriented values whi.'e less successful managers prefer more 
static and passive values, the latter forming a framework descriptive of 
organizational stasis rather than organizational and environmental flux. 
More successful managers favor a achievement orientation and prefer an 
active role in interaction with other individuals useful in achieving the 
managers* organizational goals. They value a dynamic environment and are 
willing to take risks to achieve organizationally valued goals. Relatively 
less successful managers have values associated with a static, protected en- 
vironment in which they take relatively passive roles and often enjoy extended 
seniority in their organizational positions. 

Since the value systems of Anerican managers seem relatively stable over 
time and since values are related to success, the possibility of using values 
as a selection or promotion device in att2mpting to pick people who will 
turn out to bp successful has been explored. The following expectancy table 
show the chances out of 100 of a person with a given value score being among 
the top half of managers in terms of success. 



Value Score 



*Chances in 100 of Being Among the Top 
Half of Managers in Terms of Success 



Very High (Top 20%) 



75 



High 



(Next 25%) 



62 



Medium 



(Next 35%) 



56 



Low 



(Next 15%) 



41 



Very Low 



(Bottom 5%) 



25 



*Total sample size is 875 managers 
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Value psitterns arc predictive of success and could be used in selection 
and placement decisions. Personal values are not recommended in selection 
litnatiso the Cull consequences of an Individual organization having managers 
with like value profiles are unknown. Persuasive arguments can be made that 
organizational vitality and adaptation to changing social and technological 
conditions may come about in large part because of the value mix in an organi- 
zation. There may well be some optimum range of value differences within an 
organization; but what that optimal range is tor any given organization is 
unknown. 

3. There are differences in personal values of managers working in 
different organizational contexts . One example of the impact of type of 
organization upon values is shown when compared with the personal values of 
r.S. managers with U.S. labor leaders. In general, union leaders have a 
moralistic orientation while managers are pragmatic. Owners and stockholders 
represent important values (likely to influence behavior) for managers and 
weak values (unlikely to influence behavior) for union leaders* Similarly, 
blue-collar workers and laborers represent Important values for union leaders 
and Weak values for managers. As regards organizational goals, employee 
we It are and social welfare are important values for union leaders and weak 
values for managers. Just the opposite is true for high productivity, organi- 
zational stability, organizational growth, organizational efficiency, and 
industry leadership. Finally, ambition, ability and skill represent impor- 
tant values for managers while trust, loyalty and honor are much less impor- 
tant. For union leaders, just the reverse is found. These differences help 
explain why the two groups approach various issues from conflicting directions. 
[*erhaps it is only recognition of mutual dependence as a fundamental aspect 
of modern industrial relations that allows cooperation between the groups to 
result even though it may be, as some writers have suggested, "antagonistic" 
in nature. 

An example where organizational setting does not make a difference is 
round when one compares Indian managers from the private sector with those 
t r<>m the public sector. Despite the basic differences in setting, there is 
.'.reat similarity between the value profiles of public and private sector 
managers. The profiles of the two groups correlate .98 and are almost 
identical. Although this high degree of similarity is surprising. It may 
result in part because the private sector is a primary source of managerial 
talent tor the public sector and because of the social pressure for public 
sector firms to view private sector companies as ideals in some respects 
so as to become viable economic units. These forces may result in public 
sector managers having values and concerns which are typical of private sector 
managers . 

A t inal ex/;mple of the impact of organizational variables upon value 
sy , terns is found when one looks at value differences between managers 
♦ •niph)ycd in firms of different size. In an analysis of American, Japanese 
.nul Korean managers, large firms are defined as those with 5,000 or more 
employees, medium size Tirms as those with 500-4, 999 employees and small 
Mrms as those with 1-499 employees. In all three countries, there was a 
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general trend of organizational goals being a more important part of 
managers 'value systems in large firms, less so in medium size firms and 
least important in small firms. This was the case for the goals, high 
productivity, profit maximization, organizational growth, organizational 
efficiency, aud industry leadership. There was no relationship between 
size and the importance of the goals, organizational stability and social 
welfare. The patterns in each of the three countries were similar and 
suggest that -he effects of environmental uncertainty, organizational 
complexity and conflicting organizational goals in large organizations may 
explain these findings. One might logically assume that as organizations 
increase in size, managers are confronted with more difficult, more complex, 
more ambiguous and more challenging decisions. ConHaunication and inter- 
personal relationships also become more complex and difficult, and goal 
clashes become inevitable. The consequences of these management and 
coordination problems undoubtedly are more challenging in large firms than 
in small firms and, therefore, influence top managers of large firms to be 
more aware of organizational goals and to ferret out deviations and to 
establish systems of controls and incentives which ensure internal con- 
formity with the firm's goals. Managers of small firms emphasized the goal of 
employee welfare more than did managers of largsr firms; this finding id in 
accordance with observations of many writers about the relative advantages 
of small firms* 

Personal value systems do differ in different organizational contexts 
in ways that are generally understandable. It is not known, however, 
whether these differences are largely a function of the type of people who 
go into certain organisational contexts and/or to what extend people's 
value systems adapt to the organizational context in which they find them- 
selves. 

6. There are both differences and similarities in the value systems 
of managers in the different countries studied. One indication of similarity 
is seen when the correlation of value patterns between each pair of countries 
is observ^ed. 



Japan 

Japan 
Korea 
India 
Australia 



Korea 


India 


Australia 


U.S.A. 


.92 


.67 


.64 


.76 




.71 


.64 


.72 






.85 


.79 








.95 



The correlations show that the value patterns of all the country pairs 
are significantly related. The U.S. and Australia are most similar, Japan and 
Korea are almost as similar, and India and Australia are quite similar. 
Korea and Australia, and Japan and Australia are least similar while Japan 
and India are only slightly more similar. It should be remembered that these 
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are overall country profiles that are being compared and they do not show 
the individual variation that exists within each country. These data suggest 
that cultural and social factors as opposed to level of technological devel- 
opment and degree of industrialization are most important in explaining value 
dit fortMic.\s and similarities. 

Amidst all of this similarity, thera are differences in value patterns 
between the five countries. A thumbnail sketch of several observations 
about the values of managers in each- country will highlight some of these 
differences 

U>S.A> Managers 

-Large element of pragmatism. 

-Low importance of political and social values. 

-Emphasize traditional organizational goals such as profit maximi- 
zation, organizational efficiency and high productivity. 

Japanese Managers 

-Very high element of pragmatism. 

-Value magnitude very highly (size and growth). 

-Place low value on conflict and its open expression. 

-Motivation for work seems more a product of forces external to the 
organization than internal to the organization. 

Korean Managers 

-Large element of pragmatism 

-Place low value on most employee groups as significant reference 
groups . 

-Lov importance of political and social values. 
-Low value placed on organizational goals. 
Indian Managers 

-High degree of moralistic orientation. 

-iligh relevance placed on political values. 

-Value stable organizations with minimal or steady change. 

-Value pcrsonalistic goals and status orientation. 

-Value a blend of organizational compliance and organizational 
competence* 
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Indian Managers (Continued) 



- Place low value on most employee groups. 

-Major regional differences in values of managers. 

Australian >M^^gers 

-High degree of moralistic orientation, 

-High emphasis on social and political values, 

-Place low value on growth and profit maximization. 

-Place low value on such concept as achievement, success, competition 
and risk. 

-Major regional differences in values of managers. 



7. The work then leads to the conclusion that the personal values of 
managers are both measurable and importan. to measure. Values at-^ related 
to such practical and important concerns as decision making, managerial success 
and organizational context differences. While having learned a great deal 
about values and their role in organizational life, there is still much more 
to know. It is not known, for example, how value systems develop and how 
they are changed by organizational experiences; what are acceptable or optimal 
levels of value disparity within organizations or sub-organizations to aid 
in the achievement of organizational success; what are the effects upon 
individuals of providing them with valid information about their own value 
systems; what values are most compatible with movement toward a post industrial 
era or multi-national corporate life, and finally, how value measurement 
might aid in the strain toward consistency tha^ all must make between what 
we believe and value and how we behave. 
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FOO TNOTES 

Thost'^ directly Involved in these studies have been N.C. Agarwal, O.P, 
DfiLngra, K*K:\ Henderson, T»J. Keaveny, L.D. Kim, R, Koike, R, Lee, 
Olsen, D.U. Oxnam, N.R. Rydel, k.E. Trerise and M.L. Weber. 

\ 
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CARKKR MOTIVAriON IN THE NAVY 



Albert .CUickraan, Ph.D 
INTRODUCTION 

TliO l*ri)_spoi*ts for Cluiage 

About a year and a-half ago AIR proposed itj current Career Motivation 
prt^joct under the now ONR Manpower Research and Development Program. The 
proposal recorded my impression that many of the studies undertaken during 
the past 20 years used much the same ^nethods to obtain much of the same 
results. 1 also observed how little real impact thesa results had had 
upon policy, and that if we continued to make the aamo assumptions and 
set the same inflexible limits on change, ^hc- final report could be 
written at the beginning of the project without th^ nuisance and delay 
of collecting and analyzing data* 

But there were signs that Navy officialdom recognized that the end 
of the draft signalled the need for a more probing look; that "givens" 
long unquestioned might not be applicable today; that the conventional 
ways iff coping with these problems might no longer suffice; and that there 
was need for an integrated conceptual framework — as contrasted \j±th, the 
discontinuous, fragmented, make-do improvisations that have often diminished 
the usefulness of personnel research. The storm cloud hanging over the man- 
power domain had a silver lining of "research prospects. The threat of im- 
pending disaster might actually open up real possibilities for inducing change 

Buoyed by that hope, we once again set forth upon the turbulent seas 
of career motivation research in the first part of 1972. This provides 
most of the material for this essay on the state-of-the-art of career 
motivation in the Navy. ^ 

Problem and Purpose 

The purpose of the Navy career motivation research project is 
threefold) 

(1) To develop knowledge of the influences affecting decisions 
concerning Naval service at certain key points in the life 

of a young man who is a potential recruit or an active member 
of the Wavy; 

(2) To examine current assunq)tions , policies, and practices for 
the attraction, development, and retention of personnel; and 

(3) Most crucially, to ultimately develop and evaluate new 
administrative approaches to more effectively cope wxth the 

.problems of assuring a well-qualified and motivated supply of 
manpower in the Navy. 

The emphasis given to this last point fits the impression that 
perhaps the Navy's most critical handicap in matters affecting career 
motivation is the lack of an integrated system that consistently obtains 
prompt and sensitive feedback indicating how well innovations meet expecta- 
tion, and that provides alerting signals before problems reach a critical 
level. What had been criticized as lack of organizational flexibility 
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may have rtpresonted sinrply a lack of signals for action In many cases. 

Problems may not surface for the key ^decision-maker until they have 
assumed gross proportions. So, there may be considerable time between a 
problem's genesis and the Initiation of corrective measures. Then, the 
magnitude of the remedy required becomes greater and Its Impact Is blunted 
—the opportunity to employ simpler and subtler means Is lost. Hence, 
a major requirement Is to develop better techniques for obtaining sensitive 
feedback, and to Increase the odds that such knowledge will be put to 
timely and effective use. 

Perhaps In the Navy there has been too much attention paid to how to 
Influence and change people and not enough attention has been given to how 
the organization can be changed so that It may better prepare to assimilate 
changed people, and/or to how the organization could be changed to effect 
a more effective person-organization synl>losls« 

likewise, there Is need to give more attention to the design of 
appeals, incentives, and organizational changes with specific and limited 
target populations and problem situation In mind. Too often, "mountain- 
moving" approaches are undertaken, aimed at the whole Navy. Because they 
tO' to include everyone under all conceivable circumstances, their 
overall Impact Is diluted, and It is difficult to figure out what are the 

Influences that have positive oi that have negat.lve effects, 

'J 

For these reasons, the Navy's action research objectives are being 
best served in most Instances by conducting a series of studies that fall 
into what are called a "ripple pattern"— that is a sequence of relatively 
small scale replications with modification, rather than global studies 
designed to be representative of large areas of organization and populations 
all at once. 

»' 

So, for example, to test the relative appeal of a variety of new 
incentives and organizational changes potentially affecting re-enlistment 
behavior, the research started out where an acknowledged problem situation 
already existed, so that findings that appeared to be useful might have 
a point of fairly direct application. Men are being used in three 
different kinds of shortage ratings—Electronic Technicians, Hull Tech- 
nicians, and Enginemen, located chronologically at four different points 
In the first enlistment. The Interest was to see which innovations and 
combinations of innovations appeal tp which ratings and length-of-servlce 
r.rcMjps; .ind whitfi jirv specific and which are general. Later the limits 
(»f K^ntT.il i ty will he probed by replicating with different ratings, using 
somt- (>t tht» innovations that look most promising, adding some other inno- 
v.uiDHs, .md m.iki!!^, use of longitudinal instead of cross-sectional data. 

Obviously, it would be virtually impossible to catalog every possible 
indi vidtial-oentered and organization-centered change and evaluate its 
irnpact. To most effectively exploit the potential for administrative 
innovation, a conceptual fracicwork is needed to guide the exploration and 
evaluation of potential changes — to help identify the problems that are most 
unusual; to sharpen awareness of the interactions among variables and the 
practlciil ramifications associated with given manipulations; to indicate 
wfu'r«* th«' system mipjit be most susceptible to change and where change 
indu(tii>n 'Oiild have maximum effect; to offer clues to hypothetical 
( onstrai 11^ s subject to experimentation; to provide bases for desipnina* 
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simulations, aiui so on. That is to say, we need a mcdel of iNavy career 
development centering on the motivation of the individuals involved. 
Since we ould not find one, we developed our own. 

Mi 1 i tarv and Civilian Perspect ives 

Let us stop for a moment to make a retrospective comparison of military 
and civilian 1 if e^ over the span of a generation. 

Of the most innnediate notice is the absence of the military draft, 
which, with the exception of a relatively brief pre-Korea gap, has been 
with us since World War II, as a factor conditioning individual behavior 
of American youth and»: military manpower policy. With the **zero~dr^^f t*' 
now in effect, there still remains a need for the Navy to est«*!*"'£»h its 
own special app( al amonf; eligible populations as a job and cax\ oppor- 
tunity, while operating within the range of legal and financial conss'craints 
applicable to all of the services. But no longer can the Navy rely heavily 
upon me^^i who woul.* rather ''take a char":e with the Navy" than be dratted 
into the ground forces.. Furthermore, without leverage provided by the 
draft, a^ ^ of the millt<ciry services must now meet the same conditions of 
competi . jn in the labor market as civilian employers do. 

In this connection, it should be noted that there are at least two 
characteristics that qnce sharply distinguished between military and 
civilian ] ife that are now far less salient* That is military pay and 
benefits now approximate parity with the civilian scale, and there is 
much less distinction between military and civilian codes of justice. 
Thus the attitudes toward and satisfaction with the Navy, are today to 
a much greater degree than before likely to be a function of the same 
set of perceived life style and quality variables that apply in civilian 
occupations. 

DESCRIPTION OF CAREER /MOTIVATION MODEL 

/ 

To develop the conceptual model interviews in some depth were used to 
cover the nee^ , motives, and perceptions of young men at certain key periods 
and situations in life. We spoke to young high school graduates who were 
interested and those who were not interested in joining the Navy; to junior 
college students likewise disposed; to recruiters who gave their perceptions 
of the civilians with whom they dealt; and to the sailors in various shortage 
ratings who had completed different lengths of service in their first terra 
of enlistment. 

Subsequent to the exploratory stages data ..ere fortified by more 
systematic surveys. 

What lies ahead is the development of a series of specifically tar- 
geted experimental tryouts aimed at iir proving recruitment and retention 
programs. Incorporated in each experiment, will be a follow-up study of 
organizational factors that determine how and to what extent results and 
recommendations are or are not put into practice. 

O rganizational Change Strategies 

Two major types of organization change strategies *are available. 
The first type can be called an *4ncentive-change** strategy (for example, / 
raising pay). Here the assumption is that certain incentives caa be found'' 
to alter workers' attitudes and to reinforce maintenance of new behaviors. 
The second type is an "organization-system change** strategy that implies 
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th.it a within tho* or>;ari i z<i t io'4 itself (such as a change in task 

struc ture and ass i i^nmenLs) ran U\.c! to changes in attitudes ahd bobav 
of member^ of the orj^anizat ion . So far we have stressed incentive cnange. 

A serie;> uf ^'toodbark conferenros" has been incorporated intt^ the plans 
in order to increase invoLvement of tlie Navy people wlio are active >in re- 
cruiting :.ind retentioiV po*l icy-making and operations, with th^ hope th^it 
thtv would become more experimentally oriented. 

A Tour of the Model 
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With this introduction, here is a tour of the model of career 
motivation, with a few side excursions ^o bring in some of the data and 
conceptual materials that went into its construction. 

It may be easier to think of this as a career influence and decision process 
that is revealed by following a prospective recruit through a number of 
. choice points before and after he joins the Navy. 

«» 

For this purpor»e one can think of the influence of specific Navy 
policy and practices upon the career motivation and socialization process 
as beginning when the individual first thinks about the possibility of a 
vZareer in the Navy. 

Figure 1 is the preliminary schematic thai was sketched out before 
undertaking data collection. It shows a number of key factors affecting 
enlistment and re-enlistment decisions. 

In the next set of figures there is a more complete and detailed 
representation. The following will indicate our present thinking about 
how these factors operate at each stage of the process. The model 
consists of three stages. 

c 

The first stage encompasses the re cruiting phase, where preliminary 
socialization factors influence the individual's decision as to whether 
or not to enlist. 

The second phase comprises .the ear ly> stage of the first enlistment , 
where the recruit first makes contact with living and working conditions 
in the Nav>'. Typically, this represents a radical and rapid alteration of 
lifestyle requiring great readjustment. Recruit training is the opening 
chapter of this phase. It serves as an initiation rite designed to 
provide the recruit with the basic skills, knowledge and attitudes 
pre- requisite for acculturation to the Navy §nd performance of assign- 
ments that are to follow. This stage continues through the period when the 
recruit reports for his first assignment at. a ship or station (although 
advance^ training m^ intervene). 

Transition to the third stage occurs when the individual comes to feel 
that he comprehends the intricacies of life in the Navy. This is called 
the accommodation phase to 4-ndicate that the enlistee has come to grips 
with the Navy, and has now adjusted to carr>'ing on a normal day-to-day 
existence in the organization. 

These three stal^ are interdependent. That is, the nature of later 
stages is determined by earlier events Also, what happens later may 
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lead to a re Interpretation of what took place during the early stages. 

Recruiting and Initial Socialization Influences 

As shown in Figure 2a, Block 1, a number of different factors may 
operate to influence a man's decLsibn to enlist in the Navy. Major roles 
are played by a man's peers and parents. The man's own short-term and 
long-term interests have a part in determining whether he perceives the 
N?/y to be relevant or irrelevant to his future aims. Travel, job training 
and educational opportunities—traditional appeals of the Navy — are still 
important influences in enlistment decisions. But, few people have much 
knowledge about actual opportunities that are available, and most indivi- 
duals therefore have only a vague image of the kinds of training the Navy 
can offer. Such ambiguity and uncertainty decreases the likelihood that 
a man will give active consideration to the Navy as a viable job or 
career option (Block la). For other individuals, the Navy may be viewed 
as worthy of further exploration (Block lb). 

One particularly relevant contextual factor is the American cultural 
ethos that has always tended to differentiate the role of an enlisted 
man from that of an "educated person" (cf, Stouffer, et al., 1949), 
except to a degree during World War II when the nation was under direct 
attack and compulsory military service was well nigh universal. Thus, 
the fact that youth in our society are becoming increasingly educated, and 
greater numbers of men enter college or junior college after high school, 
tends to work against a man's enlisting in the Navy, (The median education 
of this generation is 12,7 years and more than half of the youth population 
starts college,) 

In addition to increased societal emphasis on education, today's 
youth also place considerable value on the freedom to make their own 
decisions. As Levinson (1973, p. 76) has described this change: ". , .we 
are in the midst of a world-wide social re-evaluation, the central thrust 
of which is the demand of all people to have a role in their own fate," 
This is a prevailing influence in the recruiting process, since the military 
services are commonly believed to severely curtail a person^s exercisd of 
"fate control," To the extent that an individual subscribes to these 
changing values and is obtaining higher levels of education, a decreased 
interest in the Navy as a career can be predicted, unless convincing 
changes were to take place affecting relevant aspects of the Navy's image. 

Given that the man is lead to explore the Navy, he then visits a 
recruiter. Most typically the individual who visits a recruiter knows 
very little about the career possibilities available to him in the Navy 
(or elsewhere for that matter). In general, he appears to be looking for 
a job rather than a career. That is, he is not intent upon making a 
long-term commitment to some par:icular vocation; rather he is trying 
to find himself, and at the same time obtain training and experience that 
will enable him to make a career decision later on. 

These findings suggest that despite his lack of conc^ ate direction 
regarding the soiw of job he would like, the typical indi idual who gets 
ac far as the Navy Recruiting Station has all but made up his mind that 
he is going to enlist in the Navy, even before he sees e recruiter. What 
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he IS ubiK«i iv seeking from this contact Is to establish a sense of direction 
and gain some meaningful knowledge regarding working options and purposeful 
activity available in the Navy; that is to say grounds for confirmation 
rather than persuasion from the recruiter. 

Concentration on the recruiter getting immediate results may have 
obscured awareness of important long-range behavioral implications. 
The recruiter's immediate influence is not evident in persuading a man to 
enlist so much as it is in giving the enlistee information about the Navy. 
The typical prospect first decides that he wants to enlist and then seeks 
out a recruiter to supply him with information regarding Navy requirements, 
qualifications, and the choices he can make. The prospect then proceeds 
to fill out forms and take tests, all the while not having a clear idea 
of what he would like to do when he actually enters the Navy. It is 
usually only after the candidate is found to meet Navy qualifications that 
the recruiter discusses available options with him. Ihese discussions 
follow a certain predictable pattern, because the recruiter's goal is to 
enlist the individual and because the Navy's needs are quite specific 
regarding the number of men needed in particular occupational specialties 
at a particular time. 

S< t is to be expected that the recruiter's contribution to the 
prelimiiiary socialization process takes the form of presenting the Navy 
in its most favorable light. 

He reacts to cues supplied by the applicant more often than he 
initiates structure. Thus, if the prospect states his belief that recruit 
training is difficult, the recruiter is likely to agree, but point out that 
such training is good for him. In other words, the recruiter is apt to 
selectively reinforce images presented to him by the prospective enlistee 
(see Block 2b), trying to cast them in affectively positive terns (e.g., 
"being at sea is romantic" rat.^er than "being at sea separates you from 
your family and friends.") The recruiter more often seems to be concerned 
with sweeping obstacles out of the way of the prospect — rather than to 
supply motive power to it. He tries to maintain the man's momentum 
toward enlistment. 

A second feature of the recruiter's selective reinforcement procedure 
is dictated by the Navy's manpower needs. Tf the individual's interests 
lie outside those fields currently enjoying high priority, the recruiter 
steers the applicant (see Block 2b) into another field that is more 
immediately essential to the needs of the service. 

The hypothesis is that insofar as the individual already inclines 
to enlist, but ha.s little concrete knowledge about what the Navy is like 
and the actual array of options open to him, he is highly susceptible to 
the recruiter's influence when it comes to developing pictures of life in 
the Navy and to selecting a particular career field in the Navy. He is 
not In a position to critically evaluate the recruiter's description and 
recominendations. Later on he learns of other options that may actually ' 
have been available, hut since his career goals were not fixed to begin 
with, the recruiL may have initially accepted this situation as necessary. 
But when he comes to realize the full significance of his job choice, and 
when he then reports his reactions to others, a very different tale may be 
told. 
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Thus, ir addiLlon to the apparent influence of the recruiter at the 
enlistee's first choice point, the model suggest that there are other 
outcomes of the preliminary socialization process that may crucially 
affect the later development of career motivation* 

In general, most individuals who begin their enlistment have a 
highly positive and idealized image of the Navy and its programs. 
Specifically, the prospective recruit often feels that by joining the 
Navy he is assuring himself of playing a masculine role by doing rigorous 
work (i.e., "doing a man's job. ). He also probably believes that by 
joining the Navy, the work he will be doing will be important and will 
have some definite purpose (e.g., the defense of his country). Secondly, 
the recruit usually believes that the Navy operates with efficiency and 
discipline typical of the military attributes which he probably hopes to 
adopt as his own. Third, he has been told that the Navy and* other military 
services have good leadership, and that supervisors in the Navy, more than 
those found in private industry, know what they have to do and how to 
get it done. Fourth, he is inclined to believe that by joining the Navy 
he will be able to develop valuable job skills that will be. useful later 
on, particularly wheti he returns to civilian life. 

These beliefs and perceptions of the Navy serve as the backdrop 
against which later events are evaluated. To the extent these are overly 
idealized, negative reactions to Navy experiences develop. 

Early in the First Enlistment: Recruit Training and First Duty Station 

The kinds of expectancies the individual had regarding life and work 
in the Navy come into play at this stage. During the individual's 
recruit tiaining (see Block 4), it is quite likely that many of his 
expectations are reaffirmed (see Block 4b). That is, he engages in 
physical training which probably fits with his idealized image of what 
happens during boot camp. However, for some, the physical training 
probably results in an expectancy disconf irmation (see Block 4a) since 
the Nav> is perceived by many to be less physically oriented than the other 
services. (Gilbert, 1972). 

After boot camp a variety of expectancy disconf innat ions are likely 
as the individual compares his expectations with the "real" Navy. 
This particular reality confrontation is first likely to occur when the 
recruit is assigned to his Class A school. Many of those interviewed 
claimed that during classification iiiterviews, they were assigned to a 
school other than the one they believed they had been promised (see 
Block 4a). Whether or not this belief is factually based, the negative, 
affect, as indicated in Figure 2c, would lessen interest in re-enlisting. 
(It should be noted that "their choice" in many instances was not one that 
they had made in advance of being r'Lcruited. Their choi'ce of schools was 
a product of interaction with the recruiter—i.e. , the recruit had accepted 
the recruiter's choice as his own.y 

During his first duty assignment (see Block 5), the man's expecta- 
tions concerning Naval leadership become quite salient. As noted previously 
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indoctrination during recruit training aims to reinforce the expecta- 
tion that supervisors will be models of a behavioral ideal. 

Instead, a second expectancy disconf irmation may occur (see Block 
"jO., Fur many men, otiicers come to be perceived as indeed fallible 
mortals, who can he inefficient or unmotivated , .and who seem at times 
to be primarily concerned with asserting their authority and power. 
In addition, since the enlisted man has received technical training 
in his occupational field, he may see that he has technical competence 
superior in some respects to that of his officers. When officers appear 
to give inappropriate orders due to lack of knowledge, credi ility and 
respect suffer. Counterproductive socialization inputs during recruiting 
and recruit training that inflate the enlisted man's expectations increase 
the likelihood of expectancy disconf irmation when the individual actually 
works with Navy leaders. 

When expectancy disconf irmation and deflation occur there is ''back- 
lash". Thfy dispose the sailor to a "negative set" toward the Navy in 
general, and a lessened likelihood that individuals will want to reen- 
I ist. These results are consistent with previous findings (Glickman, 
I9bL), showing that many men become seriously disenchanted when they 
first confront the reality of Navy life after recruit training. 



Along this line 1 might suggest that perception of a disconf irma- 
tion gap or dissonance is perceived more insLensely by relatively new 
members of the Navy, because in their eyes the military is seen as a 
highly autonomous, self-sufficient, and higly controlled system. If 
conditions are unsatisfactory they ask, "Why can't something be done about 
it?/* Because they believe that top officials have the power to effect 
almost any change that they really want to, their expectations and discon- 
firmations may tend toward magnification. 



The model indicates that among those individuals not subjected to 
expectancy disconf irmation (see Block 5b) would be those individuals 
more likely to re-enlist. • 



Preliminary organizational socialization (by the recruiter and in 
recruit training) that more honestly reflects life and working conditions 
in the Navy might in the .aggregate lead to enhanced career motivation. 
The hard bell" often has dysfunctional consequences. This suggestion 
js; supported by the work of Weitz (1956) and Wanous (1972), where it was 
found tlsat more accurate job expectations, including knowledge of negative 
job aspects, led to a lessening of turnover. 
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Accommodation Phase 



As the enlisted man assimilates the cognitions and perceptions of 
the Navy generated by reality-testing of his expectations, he engages in 
adaptation processes through which he attempts to accommodate his life 
style to the requirements of the Navy and his personal needs (see Figure 
2c, Block 6). Cognitive dissonance processes are activated (Festinger, 
1957). Self-fulfilling prophecies take hold. 

For those who enter the accommodation phase with a "negative set," 
this phase fends to involve cumulating grievances; where the individual may 
actively seek oat, selectively retain in memory, or rewrite history to 
provide reinforcement for his predominately negative view. In which case 
the accommodation phase serves as a holding stage. The man does what he 
has to do to get by, and essentially waits out his obligation. Since far 
more men intend to, and actually do "get out" of the Navy than do "stay 
in, the environment naturally supplies more negative than positive 
reinforcements . 

The adaptive processes are, of course, different for those who 
enter this phase with a predominately positive view of the Navy. The 
experiences during this time probably have their greatest decision-making 
Impact on those who are "open-minded;" whose intentions have still not 
crystallized. 

An important aspect of the accommodation phase is that it takes 
place during a period of considerable personal change. These men mature 
from late adolescence (at age 17, 18 or 19) to manhood; many get married 
and begin a family by the time they are 22 or 23. Such personal changes 
alter men's disposition toward the Navy and the likelihood of re-enlist- 
ic.g (see Blocks 7a and 7b). Many of their values and career interests 
change and become ^.ore differentiated. 

As nofed earlier, n^iny of the men who visit a recruiter have little 
clear knowledge of what they would like to do with their lives. They 
enter the Navy with the idea that they will learr. a trade and "find 
themselves." They come to conclusions regarding their career goals as a 
result of knowledge and experience acquired only after thay get into the 
navy. It is for many the first time that chey engage in sustained job 
activity as part of a larger organizational effort and are exposed to 
value systems of a large number of people. Through this exposure they 
are able to examine their tentative career interests in long-range 
pevspective. So, it is clear that organizational changes instituted by 
the Navy to enhance career motivation must be developed against the perspec- 
tive of a changing, developing individual. 



There are several examples whicli can te cited. To begin with, look 
at those who get ^virried during the first tour of duty; this change has 
several effects. First, and perhaps most critically, the separation 
endured by a irarried couple in itself most often has aversive consequences. 
And then, the married man more sharply confronts a lack of control over 
the course of his life. Amov.^ his civilian counterparts, typically, 
dtV'isLons regarding where to live and how to raise a family are made by 
husbc^nd and wife. In the Navy, however, they lack ultimate control over 
iwia class of decisions, thus leading them to feel powerless and too de- 
pondent upon decisions of a impersonal authority. Furthermore, enforced 
absence deprives the man of considerable exercise of authority and in- 
fluence in the role ot father, and also deprives the wife of psychologi- 
cal support in the raising of children. 

Related to this is the "burr effect." As his spouse exerts 
pressure, the sailor begins to look at factors, such as leadership, 
with a more critical eye, and he becomes less willing to tolerate 
leadership practices which fall short of his (or her?) ideal. On the 
other hand, a factor that assumes increasing importance with marriage is 
that particular Navy benefits are taken more teriously. Thus, tl.e avail- 
ability of in^'irance and medical benefits are viewed quite positively 
by married enlistees, as are increased allowances for family men. Job 
security becomes more highly valued. These constitute positive counter- 
balancing appeals for some married enlisted men. 

During the firs"., enlistment the overall result of these changes is 
lessened career motivation. While the individual undergoes change, he 
perceives that the Navy does not change to meet his newly developed 
needs. The "needs of the service" seems to be a demand for adaptation that 
Is viewed by most men as one-sided and inequitable, and leads them to 
perceive re-enlistment as undesirable. 

Many large organizations may be characterized as "inflexible." But 
this need not be the case for the Navy. There are a number of avenues 
that might be followed to allow greater flexibility of career goals and 
lifestyle. For example, it might be feasible to make cross-training 
available so that an enlisted man is not forever "locked in" to k job 
without opportunity for change durir<5 his enlistment. Greater fl'^xibility 
might be built into the system to allow for change in rating, assuming 
he is no longer interested in his initial job c|hoice and can fulfill the 
requirements and obligations associated with a jshif t to a preferred 
alternative. 

RFXOMMENDATIONS 

From the very beginning of their enlistment, men come to perceive that 
they lack "fate control" (Thibaut & Kelley, 1959) over important decisions. 
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In the past, it has been taken for granted that the exigencies of military 
service leave little room for modi ftcation of the Navy^s practices to 
alter the image in terms of more flexible decision-making, initiative-taking 
and individual participation. Emphasis has been upon providing tangible 
incentives and rewards to compensate for these '^inevitable" constraints 
more than upon seeking workable organizational modifications. 

' So, if a man does not like a civilian job he can "get out," but 
in the military service he is "locked in." This is accentuated in the 
sea-going Navy, ^lere men are restricted to the same physical and social 
environment aiid tound-the-clock demands. We see fate control as a thematic 
overlay covering a large part of the cognitive map of career motivation. 
It would seem worthwhile for the Navy to make a realistic determination 
of the imperative requirements to set the boundaries within which 
individual and organizational behavior can be modified. Then can follow 
a realistic determination of the personal and organizational options that 
can be traded between the individual and the Navy. 

Innovations Affecting Recruiting 

Potential applicants often approach a recruiter hesitantly and 
skeptically. They are not confident of their ability to make. a correct 
decision, and they put no great trust in the recruiter—a stranger with 
presuned vested interests. The risk of a "mistake" is high, regardless 
of whetber the mistake can ultimately be blamed on one's self or the recruitet;. 
The consequences of a mistake are immutable; you are stuck with it. 

There are a number of steps that conceivably can be t^en to reduce 
fears associated with enlistment decisions. Well-educated applicants are 
perhaps the most sensitive to such anxieties, and they have more alternatives 
open to them. So, changes might have the greatest impact on the most 
qualified prospects. 

In a recruiting framevcrk thero are three particular steps that 
the Nrvy might mdertake: the developinent of a career behavior infor- 
mation system, the implementation of p vocational counseling program, 
and the placing of more effort on appealing to prospects in groups not 
now being given a great deal of attention, such as junior college students 
and younger high school sftidencs (ages 15-16). 

A career behavior information system , Mcfet of the information 
available regarding Navy careers is concerned with educational/background 
reqjiren:ent8 for specific Navy specialties, the kinds of training applicants 
will receive axxd how ffiuch time they must Invest to enroll in different 
career programs. 

The Navy could ci'^velcn a more complete career behavior information system 
that could describe specific Favy jobs in terms of their behavioral character- 
istics and career potential, both in and out of tlie Navy. Charrcteristics 
could be cnn^pil'jd to develop profiles for each rate, which could then be 
supplied to applicants to provide them with more complete intormation 
on which to ir.ake a career choice. \ 



Illustrative of dimensions to be included are: (a) Time spent 
intei acting with various types of others; (b) Extent of supervision of 
others; (c) Development of unique solutions to problems; (d) Typical job 
working conditions, tools, equipment, location, and (e) Hazards and safety 
factors. 

This Information system could have a number of benefits: (a) By 
reducing ambiguities associated with deciding on a career path, it 
might bring otherwise unit>terested individuals to explore possibilities 
in the Navy; (b) By enabling applicants to make more accurate decisions, 
reducing the likelihood of future unrealistic expectations and job diss-- 
atisfaction; (c) By increasing awareness of how Navy skills are 
transferable to civilian occupations; (d) Providing information to re- 
cruiters as well as school guidance counselors. 

Enlistment counseling . Another solution for some of these problems 
might be to provide applicants with professional vocatio;ial counseling in 
order to assess their personal needs and capabilities, as well as 
inforning them of options available in the Navy. 

This could be established within the framework of the existing 
recruiting network. Applicants would first present themsel\'es to the 
recruiter as they ordinarily do. Following some initial discussion with 
the recruiter and after providing the usual biographical data and taking 
the tests now in use, the applicant would be offered the option of going 
to a vocational counselor: who would review the entire situation with the 
applicant, discussing his capabillfties in terms of both civilian and Navy 
work, immediate and long term. The applicant could then return to the 
recruiter to finalize his decision to get in or stay out. 

A clear distin'^l^on should b€ made between the role of the recruiter 
and that of the inuependent vocational counselor. The recruiter's 
primary job is to match the applicant with available Navy jobs. The 
counselor is primarily concerned with the nef:ds and goals of the client, 
through selection of an appropriate job or career path in the Navy or 
elsewhere. 

Tills kind of program would appear to have a nuirber of benefits. A 
gre/iter proportion of individuals might expose themselves to a recruiter 
in order to obtain such counseling. An important barrier to overcome is 
that of getting men to begin considering the Navy. 

The counseling program could reduce anxiety associated with making 
career decisions. The applicant is less likely to feel that he is faced 
with a system that is primarily concerned with meeting organizational goals 
and only incidentally concerned with individual considerations. He may 
be expected to feel that he was more fully engaged in making his own 
deliberate choice, and thus accept it more fully thereafter. 

Furthermore, many parents bemoan the fact that adolescents lack a 
sense of direction and are unable to **find themselves.'' Vocational 
counsc '..ing would be of interest to such parents, who, in turn, might be 
more disposed to exercise indirect or direct influence upon their sons 
in favor of the Navy, or at least toward availing themselves of the free 
counseling service. 
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The ov^i^rall result of implementi -g a career behavioral information 
system and a vocational counseling program would be to: (1) increase 
the credibility of the Navy's recruiting system; (2) enable individuals 
to have more information available for decision-making; (3) increase the 
personal acceptance of the choices made, and (4) reduce the perception of 
the Navy as an inflexible organization. 

Ne w recruiting populations . This illustrates, but does not exhaust 
the possibilities affecting recruiting that we have considered in our 
reports, such as the possibilities of aiming appeals at junior college 
populations on the one hand, and pre-eltgible 15 and 16-year-olds on the 
other. 

Innovations Affecting Re-enlistment 

Within, the framework of innovations aimed at influencing re-enlist- 
ment intentions and career decisions, two courses of action seem appropriate 
(1) reducing the negative" results of false expectations, (2) "accen- 
tuating the positive" through better post-enlistment career counseling. 

Impr oving validity of expectations conveyed by recruiters and bv 
recruit training . While nuaerous sources may be responsible for genei"- 
ating inappropriate expectations among recruits, the influence generated 
through recruiters and recruit training are most amenable to direct adminis- 
trative intervention. There is a need to further examine these expect- 
ations and pinpoint the expectations that need to be altered to conform 
more closeiy to the "reality" of the Navy. 

After they are trained, recruiters and instructors could give more 
explicit and realistic infor;mation to prospects and recruits regarding the 
conditions they would be likely to find in the service. A comparative 
test could be made of the hypothesis that those with more realistic 
'expectations are more favorably disposed toward Navy careers. 

Improving post-enlistment career counseling and career flexibility . 
A number of enlisted men do not wish to re-enlist because of feelings of 
powerlessness or lack of fate control. 

Here are some examples. Once enlisted men have chosen a particular 
speciality, there is little opportunity for them to change. They see 
themselves in a management system where they have little influence on 
decisions that affect their lives. 

As a means of reducing feelings of powerlessness among enlisted 
personnel, a nu.nber of options seem to be available. 

It should be possible to expand the role and duties of career counselors 
to enable them to provide more meaningful career information and more 
tangible options. Thus, a variety of bpcjons could be made available to 
enlisted men by career counselors, fn the same way that recruiters have 
authority to make certain binding commitments. These could provide 
greater flexibility than at present. For example, one could evaluate the 
effect of shorter or indeterminate enlistments on career motivation. 
Naturally, the longer the period of time , committed by the individual, the 
more, benefits he would receive as Quid Pro Quo . 
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other options could incluv^e more opportunities to change fields of 
specialization. Greater flexibility of time commitBient might be brought 
about by: (1) making sabbatical leave available after a minimum period 
of service; (2) prbviding for leave without pay. These options would 
allow men to alternate between the civilian world and the Navy, increasing 
the individual's nob skills and maxindzing his potential for both civilian 
and Navy organizqftions • 

Implementing options such as these might have several beneficial 
outcomes* For example, men who were placed in the "wrong" specialty (from 
the man's point /of view), could rectify such "errors" by changing rates 
and obtaining additional training instead of getting out of the Navy, at 
a time and doliiar cost lees than required to find and train a replace- 
ment. Permitting individuals to commit themselves for shorter or 
indeterminate terms would allow them to perceive that they have some 
reasonable measure of "fate control" in the Navy. Moreover, if men 
were not forceJd to make absolute and final "yes-no" decisions regarding 
staying in the Navy, more individuals might be inclined to remain longer. 

Work in Progress'' > ^ 

As part of the current research on the career motivation process, 
taking the model into consideration, many of the incentives that will be 
experimented with will focus on reducing the perceived inflexibility 
of the Navy, as well as on increasing the benefits received by indivi<Aials 
as a function of the extent of their committnent (e.g.. Quid Pro Quo ) . 

Since this is a state-of -th^-art presentation, I have focused on 
hopefully heuristic content, without qualifiers and caveats. Further 
experimentation will subject these ideas to harder tests« 
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The car<'er motivation and socialization process model:' 
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RESEARC IMTO THE NATURE OF ORGANIZATIONAL EFFECTIVENESS: 

AN ENDANGERED SPECIES?''* 

2 

John ?• Cans)bell 



The content of this paper is derived largely from a search of 
existing tl^^ory, research, and" practice regarding something called 
the effectiveness of organizations, It= is part of a larger effort 
to design a comprehensive series of research projects which, if 
carried out, would advance our understanding of organizational 
effectiveness by more than a random amount. 

The purpose of these current remarks is to try to reflect the 
state of the organizational effectiveness art and make some tentative 
suggestions as to where things should go from here, if anywhere. 
Organizational effectiveness literature means literature which focuses on 
the organization or its majo/ subunitc as a degree of freedom rather 
than the individual. That ife, a look at *he criteria and determinants 
of organizational performan*, not individual performance, although in 
the end this distinction beclme rather blurred. We also tried to 
keep a research point of view rather than attempting to codify all the 
prevailing practices that exist for changing organizational performance. 
This distinction also became blurred, 

I e • 

% 

To search this literatare the primary sources were followed back 
approximately 15-20 years. • Beyond that secondary souices were relied 
upon, such as; books on orjganization theory and management or established 
literature reviews. Literature in the fields of sociology, psychology, 
political science, management, administrative and management science, 
inclustrial relations, and jorganization theory was searched as thoroughly 
as possible. The computerized abstracting services from Psychological 
Abstracts, NTIS, and DDC ^ere also employed using a wide variety of key 
words (e.g., organization theory, effectiveness, performance, analysis). 

The Literature; Descriptive Characteristics 

To further aid in setting the context, it might be profitable to 
describe briefly some of the parasieters and trends that seem to 
characterize the organizational effectiveness literature. 

1. First of all, most of it is discursive or theoretical in nature 
and not empirical. In a sense this is a recognition of the difficulty 
in doing systematic research in a domain where an entire organization 
is counted aa just one degree of freedom. As a result most of the 
empirical work consists of case study type investigations and projects 
using many degrees of freedom quite often becoi^e classics in their own 
time. / 
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2. Before the mid 1950 's toost of the systematic study of 
organizational effectiveness was carried on by sociologists j and the 
primary mode of research was .the case study, Philip 0* Selznick's 
classic study of tht? TVA is an example (Selznick, 19663) . William 
Foote Whyte's (1948) examination of the restaurant industry is another. 
Blau (1955) and Gouldner (1954) were other major contributors. 

3. March and S iinon'b (1958) classic analysis of organizations in 
terms of decision ma^^lng* and choice behavior ushered ir the era of 
psychology and management science and the number of individual research 
projects increased as did the breadth and scope of "theorizing about 
organizational effectiveness. Also, before the mid 50' s specific 
concerns for organizational effectiveness were blended in with the 
general literature on organization theory. That is, effectiveness 
tended to' take a back seat to questions of what an organization actually 
is, how many different kinds there are, how they develop, etc. A 
seminal point of departure was the 1937 Georgopoulos and lannenbaum 
criterion study which set apart the measurement of effectiveness as a 
distinct topic. Theory and research concerning organizational effec- 
tiveness exhibited its greatest growth during the 60's. If this domain 
has had a" golden era, the 60 's are it. Very recently it has seemed to 
slow and even undergo a leveling out. At the same time the nature of 
the empirical research has seemed to shift from exploratory or "one shot" 
type studies to more programmatic efforts that are guided by some sort of 
theory. Two prime examples of the latter are the research conducted by 
Likert, Seashore, and Bowers at the University of Michigan's Institute 
for Social Research (Bowers & Seashore, 1966; Likert, 1967; Taylor & 
Bowers, 1972) and the series of studies produced by ^he English group at 
the University of Aston ^Pugh, Hickson, Minings, & Turner, 1968, 1969). 

4. While research on organizational effectiveness seemed to be 
settling down to more interrelated studies based on some sort of 
conceptual framework, a parallel development has been the rapid rise in 
behavioral science based organization development . In general the field 
of OD is not research based but is practitioner oriented and directly " 
concerned with making changes in organizational effectiveness using a 
variety of techniques; and although they often protest to the contrary, 
OD specialists do make fairly strong assun^tions about what an effective 
organization should be like. These are discussed a bit later. In 
contrast to the research enterprise which seems to be coalescing around 
a relatively small number of conceptual models, the OD field has 
developed a bewildering variety of conceptual and operative models 
(Burke, 1973; Homstein, Bunker, Burke, Gines, & Lewicki, 1971). 

5. One final observation about the literature in this atfea is that 
there is a perceptible undercurrent of despair that has manifested 
itself among the research types in recent years. By contrast many of 
the OD practitioners seem to be in a state of euphoria* Organizational 
effectiveness is admittedly a con^lex topic and depending on your inner 
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strength it may look far too complicated to ev-r be resolved in any 
systematic way. The research questions of what is organizational effec- 
tiveaess and how It is determined may yet go the way of the timber wolf 
(an endangered species), or worse yet, the aardvark (an extinct species). 

Organizational Effectiveness as a Construct 

^ Based on looking at all this literature,' observing an occasional 

>^ministrator, manager, or military officer, and listening to people talk 
about organizations, there appear to be two general points of view as to 
how. one sliould assess organizational effectiveness. Thev have been eiven 
varipus labels but the most popular are the goal centered v!^ a" the 
natural systems view (e.g., see Ghorpade, 1971). 

The goal centered view makes a reasonably explicit assumption that 
the organization is in the hands of a rational set of decision makers 
whc have a set of goals in mind which they wish to pursue. Further, these 
goals are few enough in number to be manageable and can be defined well 
enough to be understood. Given that goals can be thus identified it 
should be possible. to plan the best management strategies for attaining 
them. Within this orientation the way to assess organizational effective- 
ness would be to develop criterion measures, to assess how well the goals 
are bexng achieved.- There are a number of variations of the goal centered 
view. The management by objectives tradition (e.g., Odiorne, 1965, 1969) 
as It is usually practiced tends to fall in this category. The recently 
renewed movement toward cost/benefit analysis (Rivlin, 1971) is an ambi- 
tious attempt to assess the actual utility of accomplishing specific goals. 
During the 1960 s the attempt to derive overall measures of military readi- 
ness (Hayward, 1968; Popper & Miller, 1965) is yet another variation. 

The natural systems view appears to make the assumption that if an 
organization is of any size at all the demands pl.iced upon it are so dy- 
namic and so complex that it is not possible to : if ine a small number of 
organizational goals in any way that is meaningful. Rather, the organi- 
zation adapts the overall goal of maintaining its viability or existence 
through time without depleting its environment or otherwise fouling its 
nest. Thus to assess an organization's effectiveness one should try to ' 
find out if an organization is internally consistent i^thin itself, 
whether its resources are being judiciour.ly distributed over a wide 
variety of coping mechanisms, whether it's using up its resources faster 
than it should, and so forth. One implicit assumption that the people 
with this orientation seem not to always own up to is that to be effec- 
tive the organization needs some theory or model that specifies the kinds 
of coping mechanisms that must be built and kept lubricated. It cannot 
prepare Itself for literally everything. One clear example of such a na- 
tural systems model that incorporates specific a priori notions of what 
system variables should be assessed is the one developed at the Universitv 
of Michigan institute for Social Research by Likert and his associatis 
(Likert, 1961, 1967). In the beginning the basic systematic variable 
was the degree to which subordinates participated in making the decisions 
which affected them, or to say it another way, tl>e degree to which super- 
visors snared their influence. The list has since been expanded to in- 
clude communication factors, motivational practices, and the like. The 
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focus is on "people" factors and not on the state of the organization 
technology or its physical structure. The current state of the organi- 
2:.ation is measured via a questionnaire. The most recent foimalization of 
the model and the current measurement instrument is described by Taylor 
and Bowers (1972) • Other examples are those outlined by Argyris (1964), 
Blake and Mouton (1968), and Katz and Kahn (1966). 

The principal point ) be made here is that if an organizational 
consultant were to be ^^arachuted to the xieck of a ship and asked to assess 
the effectiveness of that organization, how he would begin the assessment 
would depend in part on which of these two points of view he had inter- 
nalized. The goal oriented analyst would immediately seek out the princi- 
pal power cent ers l decision makers on board and ask them to state their 
objectives^ IT~he were wordly wise he would also employ techniques to 
reveal the actual operative goals of the organization as well as the pub- 
lically stated ones. For example, the captain's formally stated goal 
might be to have his ship score high on a specific set of maneuvers. How- 
ever, his operative goal might be to "look good enough to earn a promotion". 
For better or worse, once the consultant had the goals defined he would 
proceed to develop criterion variables that would measure how well the 
objectives (of either kind) were being met. The "validity" of a particular 
criterion for assessing the degree of attainment of a particular goal wouJ.d 
be a matter of expert judgment. Keep in mind that goals are not criteria. 
One is a desired end state and the other is an operaticnalized continuum 
representing the degree to which the desired end state is being met. 

If a natural systems oriented analyst were to fall from the sky he 
would not first ask what the organisation was trying to accomplish. 
Rather he >;ould nose around the shlf' a lot and ask questions, perhaps about 
the degree of conflict among work croups, the nature of communications, the 
level of racial tension, the perc^tage of billets that were filled by 
people'-vrTtn the appropriate level of training, what the commanding officer 
was trading away to get the personnel he wanted, the morale of the officers 
and crew, and the like. At the outset he would not be concerned with the 
specific tasks the ship was trying to perform but would be concerned with 
the overall viability and strength of the system. He would have some a 
priori notions of what the characteristics of a strong system are and hp 
would center his questioning around those. For example, if he was from 
the Institute for Social Research he would most likely administer the 
Survey of Organizations questionnaire (Taylor & Bowers, 1972). Supposedly, 
if the ship turned out to be a strong and well balanced system, it should 
be equipped to pursue a wide variety of objectives and meet a wide variety 
of demands. 

If both these analysts take their logical next steps their efforts 
will tend to parallel each other, if not actually converge. If the goal 
oriented analyst attempts to diagnose why an organization scores the way 
it does on the criteria he will soon be led back to system type variables. 
For example, perhaps the ship did not perform well in maneuvers because of 
racial tension on board. If the natural systems analyst wonders how various 
systems characteristics affect task performance, he very soon will be trying 
to decide which tasks are the important ones on which to assess performance. 
Unfortunately, in real life these second steps are often not taken. The 
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goal oriented analyst tends not to look in the black box and the natural 
systems oriented analyst does nor like to worry abi-ut actual task perfor- 
mance unless he's pressed. 

Please note that the above dichotomy appears not infrequently in 
other forms and other places. It is very similar to the general notion 
of process vs. outcome research. Research on the employment interview 
is an example. For years the emphasis was on the interviewer * s final 
judgment and its reliability or validity. Only recently have investiga- 
tors looked at the process involved in the way the final decision is 
actually made. The process typ6 studies have tended to show thdt inter- 
. viewers have well def inecLsJtereotypes pt a good applicant that may or 
may not match the requirements of the job, that negative information is . 
given an inordinate amount of weight, and that the actual decision is 
made much earlier in the interview than anybody previously realized. 
There is a strong assumption underlying this research that if inter- 
viewers are trained to know their own processes and "improve" then the 
resulting employment decisions will be "better'*. 

What Does the Literature Show? 

One of the initial objectives was to identify and catalog the major 
variables that have been used to do research on or theorize about organ- 
izational effectiveness. Consequently, every tltae some characteristic 
of an organizatioji was used as one of the focal points of a study, theory, 
or other pronouncement we noted its definition, if there was one, and the* 
coutext in which it was used. Two judges then independently sorted the 
variables into relatively homogeneous categories and gave a general name 
and definition to the category. We argued a fair amount about how many 
categories there should be, what they should be called, and how they 
should be arranged in relation to one another. The categorization has 
its obvious faults but perhaps we ,can still use this rough taxonomy to 
illustrate a few relevant points. It appears as Table 1. 
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A Listing of the Major Characteristics of Organizations around which 
the Literature on Organizational Effectiveness (broadly defined) seems 
to be focused* 



I. DEPENDENT VARIABLES 
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Overall Effectiveness . The degree to which the organization Is accompllsh- 
' ing all its major tasks or achieving all Its objectives. A general 
evaluation that takes in as many single criteria as possible and re- 
sults in a general judgment about the effectiveness of the organiza- 
tion. 

Quality. The quality of the primary service or product provided by the 

organization. This may take many operational forms, primarily deter- 
mined by the kind of product or service providf>d by the organization. 

Productivity . The quantity of or volume of the major product or service 
that the organization provides. Can be measured at three levels: . 
individual, group, and total organization. This Is not a measures of 
efficiency, no cost /output ratio is computed. 

Readiness . An overall judgment concerning the probabllliy that the organi- 
zation could successfully perform some specified cask If asked to do so. 

Efficiency . A ratio that reflects a comparison of sjme asj^ject of unit 
performance to the costs Incurred for that performance. Examples: 
dollar <5 per' single unit of production, amount of down f.dLme*, degree to 
which schedules, standards of performance, or other milestones are met. 
On occasion," just the total amount of costs (money, material, etc) a 
unit has incurred over some period can be used. 

Profit or Return . The return on the Investment used In running the organi- 
zation from the owners* point of view. The amount of resources left 
after all costs and obligations are met, sometimes 'expressed as a 
percentage* \ 

Growth . An increase In such things as manpower, plant facilities^ assets, 
sales, profits, market share, and Innovations. A comparison of an 
organization's present state with Its own past state. " 

Utilization of Environment > The extent to which the organization success- 
fully interacts with Its environment, acquiring scarce, valued re- 
sources necessary to Its effective operation. This Is viewed In a 
V long term, optimizing framework and not In a short term, maximizing \ 

framework. For example, the degree to which It acquires a steady 
^ supply of manpower and financial resources. 

Stability * The maintenance of structure, function, and resources through 
time, and more particularly through periods of si:ress. 

Turnover or Jle tent ion . Frequency or amount of voluntary terminations, 

Absenteei sm. The frequency of occasions of personnel being absent from the 
job. 

Accidents. Frequency of on-the-job accidents resulting In down time or 
recovery time. 

Morale. A predisposition. In organization members to put forth ext;:a effort 
in achieving organizational goals and objectives* Includes feelings 
of commitment. Morale is a group phenomena involving extra effort, 
goal communallty , and feelings of belonging. Gtoups havi^ some degree 
. of mortle, while individuals have, some degree of motivation (and satis- 
faction). By implication, morale is Inferred from group phenomena* 
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Table 1 

DEPENDENT VARIABLES (continued) 



Motivation. The strength of the predisposition of. an individual to 
engage in goal-directed action or activity on the Job. This is 
not a feeling of relative contentment with various' Job outcomes 
as is satisfaction, but more akin to a feeling of readiness or 
willingness to work at accomplishing the job's goals. 

Satisfaction. The degree of feeling of contentment felt by a person 
toward his organizational role or Job. The degree to which in- 
dividuals perceive they are equitably rewarded by various aspects 
of their Job situation and the organlzatibn to .which they belong 

Internalization of Organi zational Goals . The acceptance of organiza- 
tional goals by individuals and units within the organization. 
Their belief that the organization's goals are right and proper. 

Conflict - Cohesion. A bipolar dimension defined at rhe cohesion end 
by an organization in which the members like one another, work 
well together, communicate fully and openly, and coordinate their 
work efforts. At the other„end lies the organization with verbal 
and physical clashes, poor coordination, and ineffective communi- 
cation. • • 

Plexibillty - Adaptation. The ability of an organization to change its 

standard operating procedures In response to environmental changes. 

.to resist becoming rigid in response to environmental stimuli 
Evaluations by External Entities . Evaluations of the organization or 

organizational unit by those individuals and organizations in its 

environment with which it interacts. Loyalty to, confidence in. 

and support given the organization by such groups as suppliers; 

customers, stockholders, enforcement agencies, and the general 

public, 

Tl. INTERVENING VARIABLES ' ! 

Differentiation. The degree of segmentation. fragmentati<ji. or division 
of an organization along one or more factors such as function or task 
hierarchy. The measuring of this variable provides some idea of 
probable need for coordinating or integrating efforts (the more " 
differentiated, the more coordination needed). 

Job Complexity vs. Spec ialization . A job is complex to the extent that 
it is not routine, requires close attention, or is complicated, Some 
ways of measuring this are: number of separata tasks performed, number 
cf specialized operations performed at once, whether or not combined 
effort is needed, degree of predictability of work demands, amount ot 
discretion, and extent of responsibility. 

Goal Consensus. Goal consensus is the degree to which all the individuals 
in the organization perceive the same goals as the goals for the 
organization. This is distinct from an actual commitment to those goals. 
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Table 1 \ 

INTERVENING VARIABLES (continued) 

Role and Norm Congruence . The degree to which the ineiid>ers of an organi- 
zation are in agreement on such things as what kinds of supervisory 
attitudes are best, performance expectations, morale, role require- 
pents, etc/ This variable is a kind of indicator of "life style 
agreement 

Organizational Climate . A description of the organization's current 

•state as perceived by the organization members. This variable is 
usually viewed as consisting of many different facets that combine 
to form the overall perception of "climate" by an individual. The 
number and content of the facets is still a matter for argument, but 
there is some agreement on the following: 

Lndividu^ autonomy or the freedom of the individual to be his 
own boss and not having to be constantly accountable to hlghe' 
management. 

Structure or the degree to which the objectives and methods for 
the job are established and communicated to the individual by 
superiors. 

General reward orientation or the level of rewards that are 
available. 

Consideration and warmth or the support in a human ^rtfjhat ions sense 

that a manager receives from his superiors, [ 
Cooperation vs, conflict which refers primarily to\he relation- 
t shi<ps amongst peers of people in the immediate work group. ' 

Technology . The nature of actions that an individual performs upon an 
object, with or without the aid of tools od mechanical devices, in 
order to make some change in that object . * 
Structure , The actual specifications for the duties of individual jobs 
and the specifications for how jobs should relate to each other (e,g, , 
functionally, hierarchically, etc). 
Size, The total number of people in the organization or subunit. 
Stress, ^he degree of aversive stimi^li impinging upon the total organi- 
zation, subuhit, or meiikber individuals as they try to accoo^lish thteir 
mission. 

Nature of the Environment . Hie environment of an organization can vary 
Along several variables that have some li^act on the effectiveness of 
the organization. The main variables here are: degree of uncertainty 
in the environment, the general "richness" of the environment with 
regard to resources needed by the organization, and the responsive 
nature of the environment (is it benign, hostile, etc.). For example, 
each unit and subunit in the Navy is surrounded by other organizations 
and persons, as well as a local geography. These things constitute 
its environment and must be reckoned with if the unit is to survive 
and be effective. ^ 

Human Resources Availability , The extent to which required human skills 
and resources are readily available to the organization. 
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III. INDEPENI^NT VARIABLES 



Environmental Strategy, Hie strategies or procedures that an organlxa- 
tion adopts to deal with Its outside environment (e.g.. Congress, 
suppliers, radical political groups)* These may be: Ignore it 
monitor it, bribe it, reinforce it, etc, * 

Human Resources Manatrement> The way in which individuals are selected 
for the organization ana trained and assi^ed to organlaKational 
roles. How "wisely'* the organization utilizes people. 

Coordination. An individual,*^ group, or set ox procedures which ^or 

t^grates parts of the organization toward the objectives of the whole 
organization. Coordination will be found to soiae^ degree whenever 2- 
or more separate units work simultaneously toward the saae objective 
or sequentially on the same product. For particularly co^>lex or- 
ganizatiohs, whole unics devoted to coorditiating other unl^s are' 
sometimes created. 

Resource Allocation. The degree to which all available resources are 
allocated to organizational needii and/or units in ways th'at contri- 
bute toward achieving the organization's goals. 

Information Managemen t and Comrounication . The collection, mialvsis, and 
distribution of information critical to organlztttional effectiveness. 
Includes the degree to which: mechanisms for ongoing tonitoring of 
pertinent. information are established, some ntethod for filtering 
biases from collected information is used, a"" tegular and efficient 
channel of distribution of relevant information to concerned organi- 
zational members is established, and informal coomunicaticn lines 
transmit organizationally valuable information. 

Control (Amount of). The total degree of control that exists for influen- 
cing and directing the behavior of organization iiieod>ers. Much of the 
work on this dimension has' been with the total * amount of control in 
an organization as well as the distribution of control. 

Managerial Interpersonal Skills, The skill and efficiency wJLth which the 
manager deals with iM superiors, subordinates, and peers. The extent 
to which he gives support, facilitates const met xve interaction, anc 
generates enthusiasm foi meeting goals and achieving excellent per- 
formance. Is meant to include sucn things as consideration, employee 
centeredness, LPC, etc. 
Managerial Task Skills. The skills a manager, commanding officer, or grcup 
leader uses in performing tasks centered on work to be done, and not 
with the people he manages. This includes: skill in planning of 
activities, scheduling to avoid lost time, spending little time on 
crises, coordinating activities with other units or organization^ , 
utilizing staff assistance, and providing resources such as stools | 
materials, and technical knowledge. 
Nqn Managerial Inter personal Skills . The degree to. which the non managorlal 
staff is open and honest with co-wrkers, support each other i give 
feedback y etc. 
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Table 1 * * 

INDEPENDENT VARIABLES (continued) 



Quality of Technology , The state of repair, capability of availability 
of, and technical adequacy of an organization's technology. 

Formalization of i^rocedures . The extent to which an organization has 
written or otherwise codified specifications for suCh things as job 
duties, responsibilities, promotional paths, authority lines, and 
communication lines. • ' ' 

Task Goal Clarity . The degree to which organizational task goals are 
clearly defined and stated (not necessarily understood ot accepted) 
and the degree to which they are congruent with the organzational 
mission* ^ ^: 

Operative Rewards , The specific outcomes which serve as. positive or 
negative incentives and rewards in an organization** 

Reward Procedures , The process by which organizational taeibers ate 

rewarded, specifically as it varies on the parameteis of selectivity 
^(who gets rewarded), instrumental clarity (the clarity of the basis 
for reward), and length of feedback loop (between performance and 
reward) . • 

Participative Decision Making . The degree to which control over the 
work process and decision making is- dispersed through the organiza- 
tion. Participation can vary on a dimension of having an opportunity 
to contribute to a decision by giving opinions and information, as 
well as actually having a "vote" on the actual decision. 

Organizational Support . The general supportiveness of the organization 
toward its meiAers, the amount of supportive behavior engaged in by 
organization members, and the amount of effort by the organization 
to insure th^ physical safety and other kinds of protection for its 
members. 

First, the total list is broken into at least a trichotomy consisting 
of independent variables (or inputs that could be manipulated) , dependent 
variables (or the outcomes that are of real interest and that constitute 
.some sort of payoff), and intervening variables (or the "given" charac- 
teristics of organizations that, depending on the degree to which they are 
present, might make a difference in the way a change in an , independent 
variable affects a dependent variable). For example, should organizational 
structure be taken as a "given" and viewed as some kind of moderating 
variable, or is/ it something that can be manipulated as an independent 
variable? In organizations with long traditions such as the Navy maybe it 
must be taken as a given, but maybe not. In general, there are serious 
and important questions to be aslced about which characteristics of organi- 
zations are manipulatable "handles," which are the outcomes of real interest 
upon which the organization's payoff is based, and which act as constraints 
on, or modifiers of, the intended effects of pulling the handles. 

Obviously, the items on the list also vary a great deal in terms of 
the degree to which they have been operationalized, or have the potential 
for being operationalized. Not all of them by any means have appeared in : 
empirical studies. ^ 
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The fol.owing section is to characterize the current state ot 
affairs within each/of these three major classes. 

A^Co nside ration of Dependent Variables ^ 

Several things are immediately obvious about the list of dependent 
variables. First, there are a lot of them and there have been precious 
few attempts to weed out the overlap and. get down to the basics. , ' 
Sw? •.J''*^ considerably cn a dimension of generality/specificity. 

Third they vary on an objective vs. perceptual measurement dimension. 
Fourth, they vary on a continuum that could be called closeness to the 
real payoff. For example, is morale the continuum on which the real 
payotfs are made or is it a means to an end? That is, is morale iBDOr-^ 
tant because it is related to some more distal variable that is the 
organization's real concern? This is not precisely the same thing as 
Thorndike s classic distinctions among iamedlate. Intermediate, and 
ultimate criteria. Morale may Indeed be the desired outcome of real 
interest and we could consider immediate, intermediate, and ultimate 
ways of measuring it. Rather, this distinction really points up 
several other issues. One is that the decision about which of these 
are means and which are ends is a value Judgment on somebody's part. 
It is made implicitly or explicitly in organizations every day and 
cannot be avoided. Second, if the decision is that particular variable 
IS a means and not an end, is it necessary to demonstrate emlrlcal 
relationships between that variable and the outcomes of real interest? 
Or Should those relationships be assumed, since the outcomes of real 
interest are usually so difficult to specify and measure? It is pre- 
cisely here that the goal model and natural systems model diverge. 
Most theorists, researchers, and practitioners who adopt the natural 
systems point of view appear to accept the basic assumption that the 
systemic variables contained in their model are significantly related 
xn a causal fashion to accomplishment of a .variety of organizational 
missions. In contrast the goal model demands data. 

In the best of all possible worlds it would be nice to have some 
overall hierarchical map of how the criteria fit together in terms of 
their generality /specificity and means/end relationships. Perhaps 
part of this map could be determined empirically but, for reasons that 
will be discussed later, a good share of it must be specified Judgmen- 
taliy and such judgments be made more reliable, explicit, and valid. 

There have been only two systematic attempts that are known to 
search for the major factors comprising the dependent or criterion 
variables of organizational effectiveness. One of these was done at 
the University o± Minesota Industrial Relations Center by Mahoney. 
Weitzel, and others (Mahoney, Frost, Crandall, & Weitzel. 1972: 
Mahoney & Weitzel, 1969) and the second is the well known effort by 
Seashore, Yuchtman, and others at the Institute for Social Research 
(Seashore & Yuchtman, 1967). 
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The Hinnesota study used a questionnaire format to obtain ratings 
on the effectiveness of 283 departments or subunits sampled from over 
a dozen different firms. The ratings were made by managers at least 
one step removed from the direct management of the subunit. and the 
questionnaires included 114 items gleaned from the literature as being 
potential indicators of effectiveness. The correlations among the 114 
items were factored and 24 effectiveness factors were labeled and 
defined. They are listed in Table 2. 

Table^ 2 

Twenty-four dimensions of organizational effectiveness, derived 
from a factor analysis of ratings on 114 effectiveness criteria for 
283 organizational subunits. Ciiterion variables were selected from 
a list of variables studied in organization theory literature, and 
rationally developed by the authors (from Mahoney & Weitzel, 1969). 

Flexibility. Willingly tries out new ideas and suggestions, ready to 
tackle unusual problems. 

Development. Personnel participate in training and development activi- 
ties; high level of personnel competence and skill. 

Cohesion. Lack of complaints and grievances; conflict among cliques 
witiiin the organization. 

Democrati c supervision . Subordinate participation in work decisions. 

Reliability. Meets objectives without necessity of follow-up and 
checking. 

Selectivity. Doesn't accept marginal employees rejected by other or- 
ganizations. 

Diversity. Wide range of job responsibilities and personnel abilities 

within the organization. 
Delegation . High degree of delegation by supervisors. 
Bargainins> Rarely bargains with other organizations for favors and 

cooperation. 

Emphasis on results. Results, output, and performance emphasized, not 
procedures. 

Staf finj^. Personnel flexibility among assignments; development for 
pronation from within the organization. 

Coordination. Coordinates and schedules activities with other organi- 
zations, utilizes staff assistance. 

Decentra lization . Work and procedural decisions delegated to lowest 
levels. 

Understanding. Organization philosophy, policy, directives understood 

and accepted by all. 
Conflict. Little conflict with other organization units about authority 

or failure to meet responsibilities. 
Personnel planning. Performance not disrupted by personnel absences 

turnover, lost time. * 
Superviso ry support . Supervisors support their subordinates. 
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Table 2 (continued) 



Planning * Operations planned and scheduled to avoid lost tine; little 
time spent on minor crises. 

Co ope rat ion > Operations scheduled and coordinated with other organiza- 
tions; rarely fails meet responsibilities. 

Productivity-support- tilization . Efficient performance; mutual support 
and respect of supervisors and subordinates; utilization of personnel 
skills and abilities. 

Cocanunication ^ Free flow of work information and conmunicatlons within 
the organization. 

Turnover . Little Curnover from inability to do the. job. 

Initiation . Initiates improvements in work methods and operations. 

Supervisory control . Supervisors in control of progress of work. 

Note. -From T. A. Mahoney and W. F. Weit:?el^ Managerial model of 
organizational effectiveness. Administrative Science Quarterly ^ 1969^ 14, 
357-365. 

Each subunit was also rated on "overall effectiveness" and a major 
additional step was to cot^ute a multiple regression equation regressing 
the 24 factors against the overall rating. The regression analysis was 
done for different types of subunits, for organizations of different 
sizes » and for organizations employing different technologies. In 
general, the factors which account for greatest variance in the overall 
effectiveness rating are not the same across the various breakdowns of 
the total sample of subunits. Tliat is, the ccri^ositon of overall 
effectiveness is different for production vs. R & D units, for mass 
production first unit production^ etc. 

The effectiveness dimensions identified by the ISR group in a factor 
analytic study of the performance of 75 insurance agencies are shown in 
Table 3. 

Table 3 

Ten dimensions of organizational effectiveness derived from principal 
component analysis and vatimax rotation of scores on 76 performance 
variables for 75 life insurance agencies. Performance measures were 
selected from a list of such criteria used by parent company to assess 
agency effectiveness (from Seashore & Yuchtman, 1967). 

Business volun^ . Expresses different aspects of organization size in 
respect to manpower and to number and value of policies sold. 

Production cost . Efficiency of sales, production process; cost per unit 
of sales volume. 

New member productivity . Productivity of menders having less than 5 years 
tenure with agency. 
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Table 3 (continued) 



Youth fulness of members . Relative frequency and productivity of members 

under 35 years of age. 
Business mix ^ A combination of three conceptually unrelated performance 

indices 9 interpreted as reflecting the ability of agencies to achieve 

high overall performance through any of several strategies. 
Manpower growth . Relative and absolute change in manpower levels. 
Devotion to management . Sales comiissions earned by agency managers » 

high commissions are interpreted as reflecting high interest in sales 

and corresponding low interest in management activities. 
Maintenance cost . Efficiency of administration of manpower » plants and 

established customer resources. 
Member productivity . Average new business volume per agent. 
Market penetration . Proportion of potential market that is being 

exploited. 

Note. -From S. E. Seashore and E. Yuchtman^ Factorial analysis of 
organizational performance. Administrative Science Quarterly , 1967, 12 
377-395. 

The basic data for this Michigan study were not questionnaire 
responses or subjective ratings but consisted of archival records of 
sales and personnel data. The nature of the business which was studied 
makes it hard to generalize these results but a number of findings are 
suggestive. For example » relative to the "devotion of management" 
factor one could ask how much time a squadron comfiiander spends flying 
vs. managing « 

Based on their own data and related Experiences^ Seashore (1972) 
has drawn several negative "morals" concerning effectiveness criteria. 
To wit: ^ 

1. If several raters arc: osked to rank order a number of organiza- 
tions or organizational subunlts in terms of their overall effectiveness 
the interrater agreement is usually quite low. Unless they are all of 
extremely like mind^ different raters tend to focus on different facets 
when making their judgments. 

2. In the real world criterion measures sometimes correlate ne- ' 
gatlvely when they aren't supposed to, 

3. In the real world so-called hard iiata or "objective" criterion 
measures usually turn out to be quite "soft." No one needs to be 
reminded that in almost all cases any number of artifacts and biases 
operate to water down the fidelity of objective measures such as profit^ 
costs » turnover or retention rates, number of missions flown^ etc. 
There is no refuge in objectivism. 
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4. In the real world it Is probably a mistake to think of 
effectiveness criterion variables i regardless of how many there are 
or at what level they are^ in terms of continuous and linear functions* 
For example p hi^er and higher retention rates may be "good** up to a 
point and then become '*bad/* Notice the perspiration that begins to 
flow when we ponder the ioqilication of the words gpod and bad. 

In totals Seashore's misgivings brood ill for the shotgun factor 
analytic approach to objective criteria of organizational effectiveness* 

With the exception of these two examples very little systematic 
work has been done on trying to identify and measure the component 
criteria of overall effectiveness; and^ obviously » there are a nuflober of 
parameters that serve to circumscribe both the Minnesota and Michigan 
results. By and large» the remainder of the research studies chose 
criteria on the basis of availability and made no attempt to study the 
"^criteria themselves. It is unfortunately the case that there are many 
alternative measures of quality » productivity » profitability ^ turnover » 
and the like^ and we usually have no basis on which to predict how these 
alternative Indices will be related to one another* 

As was noted previously^ a theorist » researcher » or practitioner in 
this filed who is not a rigid adherent to the goal model must necessarily 
have some a priori notions about dependent variables that are important* 
Sometimes these have been explicitly and formally stated and sometimes 
they have not. An example of an explicit statement is the set of 
dimensions measured by ISR's Survey of Organizations questionnaire 
(Taylor & Bowers » 1972). These vatiables and their definitions were 
shown as Table 4. 



Table 4 

Perceived dimensions of organizational characteristics assessed by 
the Survey of Organization's questionnaire (Taylor & Bowers^ 1972) • 

1* Climate ; perceived total impact upon a work group of the behaviors 
of superior work groups in terms of: 

a) High or low concern for human resoui.c«es 

b) Adequacy of communications flow 

c) Nature of motivation to perform 

d) Decision making practices 

e) Technological readiness and flexibility 

f) Amount of lower level influence in departmental decisions 

2. Supervisor leadership 

a) Support: behavior that enhances someone else's feeling of. 
personal worth and importance 
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Table 4 (continued) 



b) Interaction facilitation: behavior that encourages 
members of the group to develop close ^ mutually 
satisfying relationships 

c) Goal eiqphasis: behavior that stimulates an ^thusiasm 
for meeting the g7.x>up's goal or achieving excellent 
performance 

d) Work facilitation: behavior that helps achieve goal 
attainment by such activities as scheduling^ coor- 
dinating^ planning^ and by providing resources such as 
tools ^ materials^ and' technical knowledge 

3. Peer xeadership 

a) Support 

b) Interaction facilitation 

c) Goal emphasis 

d) Work facilitation 

Interpersonal processes within work groups 

a) Confidence and trust among menibers 

b) Strong^ shared motivation toward goal attainment 

c) Effective group decision making 

d) Effective, open communication within the group * 

e) Mutual help and coordinated activity 

f) Flexibility^ adaptability, and creativity 

g) Job competence through skill upgrading 

5. Satisfaction with : 

a) Supervisor 

b) Work group 

c) Job 

f $i) Organization 

j e) Pay 

f> Past progress within the organization 

^ g) Future expected progress within the organization 

b. Performance 

a) Volume of work 

b) Efficiency 

c) Product quality 

d) Attendance 

e) Organizational and manpower growth and development 

f) Human costs (e.g,^ accident rate^ health, stress, 
grievances) 
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Bennis (1965) has noted that nuDst researchers and practitioners 
in the behavioral science brand of organization development have very 
definite ideas about what an effective organization should be like but 
they are often not explicitly stated. Even though there are many 
variations in OD t/Bchniques, Bermis (1969) has also noted that there 
is a fair amount of homogeneity i^n the desired end product. 

At the risk of satisfying no one and alienating everyone, the 
following list is a description of what the behavioral science OD 
orientation would regard as an effective organization, 

1. There are pervasive and shared norms of openness and trust. 

2. Interpersonal and intergroup conflict is dealt with openly and 
without defensiveness. ^ 

3. Communication among individuals and groups is frfequent, .accurate, 
non defensive, and reflective of whatever emotional component the 
messages actually possess. 

4. Problem solving among^ individuals or groups utilizes the kinds 
of interpersonal and communication skills gleamed in a T-group. 

5. The hierarchical and functional relationships among people are 
a function of their expertise vis-a-vis the task rather than formalized 
role specifications. 

6. To the fullest extent possible, jobs are designed and Job 
assignments are made such that individuals can experience feelings of 
achievement and self-actualization. ' 

Consideration of such a list illustrates that probably tione of these 
variables are what a goal oriented researcher or practitioner would refer 
tp as an organizational objective. Organizations are created for the 
purpose of producing certain goods or services or accomplishing certain 
tasks. Whatever the specific objectives might be, the OD point of view 
seems to assume that, they will be achieved if the organization could 
successfully develop the "means" listed above. 

Intervening Variables 

In general, the variables in this list are characteristics which 
describe the organization as a particular entity. They refer to the 
structure of the organization and its processes which together distinguish 
it in form from other organizations. It is these sorts of variables which 
have been used by a number of people to develop typologies or taxonomies 
of organizations (e.g., Blau & Scott, 1962; Etzioni, 1961; Hall, 1972; 
Woodward, 1965). 
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The variables themselves tend to break down into tw^j^jor types, 
according to whether they are measured via the percept i€|^^^he 
organization members or by more "objective" means such HHPIonnel 
.records, observations of the work process, and the like. /perceptual 
measures usually, but not always, go under the general' label of organi- 
zation climate. Roy Payne's paper in this same volume makes a somewhat 
different distinction. Most attempts to measure climate have used a 
test construction type approach in which a large number of paper and 
pencil items are amassed and the total pool is intended to sample all 
the characteristics of an organization that might distinguish it from 
other organizations in the eyes of its members. That is, the usual 
intent is to measure characteristics of an organization that are defined 
and organized in the way the individual's perceptual apparatus organizes" 
them. The components of organizational climate should be the same 
* components that an individual uses when he looks at his organizations 
and asks, "what kind of a place is this.?" 

The items are intended to permit the individual to describe, not 
evaluate, the organization. For example, the individual might be asked 
to judge the degree of felt pressure to get work done but not evaluate 
whether there is too much or too little. This is not always an easy 
distinction to make. Likewise a description of an organization's climate 
is meant to be something different than an individual's judgment concern- 
ing whether he is equitably rewarded, or satisfied, with his job outcomes. 
Logically at least, there is a difference between saying that most jobs in 
a particular organization are very autonomous an^ saying that you yourself > 
are satisfied with the degree of job autonomy which iyou have* The climate 
judgment is intended to be much less a function of individual* differences 
than is job satisfaction, and more a function of the organization or 
subunit of which the individual is a member. 

A number of different questionnaire measures of organizational climate 
now exist (Campbell & Beaty, 1971; Litwin & Stringer, 1966; Schneider & 
Bartlett, 1968; Taylor & Bowers, 1972) which vary somewhat in length and 
content but which seem to tap at least the five components subsumed un^der 
climate in the list of intervening variables in Table 1. Regarding the 
nature and usefulness of ^limate, a great deal of empirical argument is 
currently going on about how* many components there are, whether they are 
defined the same way for different organizations, whether climate percep- 
tions can really be differentiated from job satisfaction, and whether the 
differences between observers as a source of variation outweighs the 
differences between organizations. The answers are not yet in. 

Saying that climate is an intervening variable does not help much in 
specifying how it actually can be used to explain the organization's 
effectiveness. Unfortunately, the literature provides very little concep- 
tual assistance. Investigators have worried more about how to measure 
climate rather than about the role it should have in explaining organiza- 
tional behavior. In spite of this, several empirical studies have yielded 
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promising results. In a large simulation study, Frederiksen et al. 
(iTrederiksen, Jensen, Beaton, & Blo3tt)m, 1972) showed that "consistent" 
climates yielded higher [pi jductivity and that an autonomous unstruc- 
tur-^ ^^'nosphere permitted Individual skills and abilities to play a 
greater rOle in individual performance. In a rather provocative study ^ 
Schneider dnd Bartlett £1^70) compared the climate of insurance 
agencies as described by 'he managers and by the agents. There was a 
substantial correlatioa between the productivity of the agency and the 
degree to which the two profiles matched* 

On the face of it at least, the way an individual percefS?es an 
organization should have a great deal to do with his reward expecta- 
tions and thus his behavior. It should also have something to do with 
how an individual perceives the tasks he is to perform (e,g. , are they 
deiuanding or easy?) and the strategies .he selects for acconqilishing 
,them (e.g., is it okay to "cheat?"). 

On the objective si(3r> of the Lewinian dichotomy, there also has 
beenj considerable activity. A number of researchers, primarily in 
Great Britain, have been trying to develop measures of the structural 
and process components that characterise organizations. Perhaps the 
two najor efforts have been those by Joan Woodward (1965) and the 
group at the University of Aston (e.g., Pugh, Hickson, Minings, " 
MacOonald, Turner, £. Lupton, 1963). They are illustrative of the 
s&nf^e of the art pertaining to how structure and process can be measured 
arid/ the degree to which they can be used to explain organizational 
fmijftioning. 

Both sets of researchers acqnired a sample of 40-50 firms (in Great 
Britain), proceeded to visit each firm, and used interviews, organiza- 
ti6nal charts, and archival records to collect a great deal of data 
pertaining to the type of technology employed (e.g., batch, unit, con- 
tinuous flow), the total organization size, s^ze of various subunits, 
span of control in various subunits, locus of decision making, and the 
like. The Aston group has been the more vigorous in trying to develop 
standardized measures of many of these variables. For example, by 
factor analytic type procedures they^ have developed what they hope are 
measures of the basic components of organizational structure. These 
factors they derived are givdn in Table 5. 

Table 5 

Four factors of organizational structure identified via a factor 
analysis of non perceptual measures (PUgh et al. , 1968, 1969) • 



Factor 



Definition 



Structure of Activities 



The degree to which the behavior of 
employees is defined by dividing work 
into specialist jobs, laying down rou- 
tines, procedures and formalizing them 
by insisting on written, records^ etc. 
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Table 5 (continued 



Concentration of Authority 



\ 

Degree to which authority to take 
decisiors is concentrated at the top 
of the organization, or outside the 
organization, if it is part of a 
Jatger company. 



Line Control of Workflow 



The degree to which control" is 
exercised by line personnel as 
against its exercise through im- 
personal procedures. 



Relative Size of Supportive 
Component 



The relative number of non-productive 
personnel i,e, auxiliary support to 
main workflow. 



Although both studies are cross sectionaX, both Woodward and the 
Aston group seem to focus on the causal and developmental relationships 
among technology, size, structure, and management practices. By and 
large they do not concern themselves with organizational effectiveness 
or individual effectiveness. They are still at the level of sorting out 
the internal relationships. For example, one bone of contention is 
whether organization size determines the technology employed or vice 
versa. Perhaps the more interesting data are the relationships between 
management practices and technology. There are some hints in Woodward's 
data as to what kind of management might be needed as an organization 
becomes more highly technical and automated. One provocative suggestion 
here is that to a large extent management practices are predetermined by 
the technology of the organization. Changing management practices via a 
selection or training strategy would be that much more difficult. Rather, 
the emphasis should be on "enhancing** whatever kind of management the 
technology calls for. 

The work of the Aston group has now been extended in several additional 
studies. Child (1972) attempted a direct replication in a nationwide 
sample of ^82 English firms. Additional extensions have been carried out by 
Inkson, Schwitter, Pheysey, and Hickson (1970), Hickson, Hinings, McMillan, 
and Schwitter (1971), and Payne and Mansfield (1972), As noted by Payne 
and Pugh (in press) the results from these studies pertaining to internal 
relationships among structural variables seem to exhibit considerable 
stability and meaningfulness. 

However, in' total, the research on structure and process variables 
has not gotten very far toward determining their role in organizational 
effectiveness and this seems to be true of the intervening type variables 
in general. To really map out their effects is going to require studying 
a very large number of interactions which will chew up degrees of freedom, 
the likes of which we have never seen. 
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Independent Variables: Which Handle to Grab 

e 

This category contains what Is probably the bu.llc of the literature 
m Industrial and organizational psychology and although tempting (sic), 
we do not wish to recount all of It. One thing that should be pointed 

°^ research on these various "handles has focused on 
Individual behavior or porformance as an Independent variable. There 
are very few studies which have used organizational units as degrees of 
freedom, '&a for example in comparing various selection strategies or 
training methods. Again, the work done at Michigan by the ISR group Is 
the most notable exception and the principal handles which Ukert, Bowers, 
and Seashore have grabbed are primarily managerial Interpersonal skills, 
conmunicatlon methods, and participation In decision making. In their 
cross sectional studies of package delivery "outlets (Georgopoulos & 
Tannenbaum, 1957) and Insurance offices (Bowers & Seashore, 1966) and In 
the longitudinal case study at Harwood Industries (Marrow, Bowers, & ^ 
Seashore, 1967), these variables have tentatively been shown to have 
generally positive relationships with various measures of organizational . 
effectiveness. 

Beyond this there Is not a great deal of organizational research that 
can be differentiated from Individual research which Is too bad since 
many of these variables have been shown to be related to Individual per- 
formance. The people who call themselves OD practitioners do 'indeed 
manipulate some of these variables In hopes of producing changes on some 
organizational dependent variables but they tend to collect very little 
research, data. The exceptl^ons to this generalization are a relatively 
small number of data based studies such as that done by Blake, Mouton. 
Barnes, and Gr^lner (1964). 

One thing that might be useful Is to look at the list of Independent 
variables with an eye towards the kinds of machanisms by which they might 
exercise their effects. A list of such mechanisms might appear something 

as follows. ^ rr •» 

1. The aim could be to Influer.ce a unit or organizational: choice of 
tasks or problems on which to work and the degree of effort expended once 
the choice Is made. This Is a so-called "motivational" consideration and 
involves task choice and task effort. 

2. The aim might be to Increase an organization's understanding of 
the task to be performed or problem to be solved. 

3. Another possible mechanism Is to Increase the organization's 
basic underlying aptitudes (e.g, select more competent people) for the 
task Involved. 

4. Another Is to Increase Its specific task skills through some kind 
of training. 
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5« Finally 9 a change In equlpnent or tachuology for tha task 
might be a way to Increaae organizational effectiveness. 

It might be of interest to juxtapose this basic set of nschanisM 
. against a simple listing of all the different isathods that have been 
used to change organizational effectiveness » at least to some degree. 
This list appears as Table 6 and is everything %ie could think of, based 
on the current literature reileir plus others we have done. 

TiOile 6 

Partial listing of possible methods for changing the effectiveness 
of organizations. 

Pe rs onne l\e lec t ion 

Personn^ classification 

Career assessment and career planning 

Individual training 

Orle^ntatlon training 

Skills training 

Hanagerial ar 1 leadership training 

Human relations training 

Training to enhance nAch 
Individual counseling 
Changes in promotional criteria 
Incentive 9 or contingent , pay 
Cafeteria pay pl^ns 
Scanlon plan 
Behavior modification 
Flexible sc^^duling 
Job enlargement 
Job enrichment 

Participation in decision makii^ 

Organization development methods (behavioral science based) 
Surveys* feedback 
Int e rvlev- f eedb ack 

Problem solving meetings (temporary task forces) 

Laboratory training 

Confrontation 

Process observation and feedback 

Managerial grid 

Team development 

Intergroup laboratory 
Management by objectives 
Changes in organizational structure 

Changes in functional arrangements (e.g., definitions of task 

responsibilities) 

Changes in managerial controls (e.g., human resources accounting) 

Matrix management 
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Table 6 (continued) 

Changes in organizational processes 

iHanageinent inforiaatlon systet^s 

Operations research and analysis 

Communication practices 

Manpower planning techniques 
Advances In technology 

considering such a juxtaposition of underlying aachanlsns against 
specific techniques poses some interesting questions about how various 
independent variables work. For exaople^ does participation wori 
because it Influences choice and effort (motivation input) or because 
it leads to better utiilzailon of infomation (a cognitive input)? 

The moral here is that the more we understand about the processes 
involved the better off we are. However , organizational researchers 
have not often looked insicte the black box. There is a wealth of data 
on correlating these various Independent variables with selected 
dependent variables but the processes Involved are seldom examined 
systematically. It would be co our advantage to do so* 

Soiae Conclusion^ and Imi;licatlons 

Based on this looR at the "state of the art" concerning organizational - 
effectiveness I the suionary com^nts are as follows: 

l» Mapping out the empirical relationships among some set of ir.-^e- 
pendent, intervening, and dependent variables with the aim of an overall 
understanding of how organizations work is a futile undertaking. It is 
impossible at this time to acquire ttm necessary degrees of freedom to 
investigate very many interactive relationships or even to pursue silti- 
varlate analyses of any con^>lexlty. It must likely is not possible t 
use empirical multivariate techniques to Investigate the dlmenaionalit^ 
of organizational effectiveness. Somehow the mess created by accepting 
the fact that organizations are con^lex must be bypassed. 

2. Generally speaking, the notion of overall orgmiil^atlonal 
effectiveness cannot be given a substantive definition. It sioply has 
too many parts that lose their meaning when they are added together. It 
is possible of course to ask observers to rank order organization on one 
continuum without asking them to specify the nature of the contJnuum, but 
the degree of agreement will vary depending on the degree to which 
observers are focusing on the same facets in the same way, and if these 
dynamics aren't examined, the state of kiK^ledge will not have advanced 
very far. 

3. A disclaimer one often hears about %rtiether a particular relation- 
ship between an independent and dependent variable will be observed is 
that it "depends on the situation^" meaning that organizations are 
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different and what might be true in one will not be true in another. 
As a response, a number of people have offered up taxonoBdw^f 
bl'tl^r °r outline the basic^differe:;:: iL „«st 

ora«S!-^f i ""^ °^ advancing our understanding of 

n!? ;f effectiveness, this too has been a futiU underfakiaa 

Other kinds of intervening variable research era stilllnljSSlij^cy. 

zatio; of T±tTf^^^ °^ has been the effects on the organi- 

' " ?he enu'^e L;^i f^' °' P*°P^« *~ enterl^T 

o«anlz!tlonir t organizational effectiveness research and 

organizational change has a very environmentalist point of view This 
is an unfortunate state of affairs for organizations whl^ IrTlhout to 
undergo massive changes in the way they rfcrult ^^^sSiS ^^rs 

5. The most fruitful research has not been that which tries to 

freedom"? tH '"^''"^ '^^^ organization^ a of 

illttZ ? J* ^° individuals. Rather, an Idf^Sred 

X fi^e"t^e°foIltinir^" " "^^^"^ "^^"^^ '^^^^^^ 

. Drop back to individuals or work groups as degrees of freedom. 

. Focus on dependent variables that you are willing .o assume have 
an important link to overall organizational functioning. 

. Include as part of the research program a systematic look at the 
process involved. That is. instead of demonstrating only that a 
program of job enrichment resulted in high retention ratce for 
skilled personnel, get inside the organization and try to find 
out precisely how the various elements of the job enrichimsnt 
program affected the people involved. If the dynamics could be 
illuminated you should be in a much better position to predict 

. whether a particular relationship will generalize. In general, 
we think it would be much more fruitful to identify the procesi 
parameters in a particular independent variable-dependent 
variable relationship and then see whether these are present in 
some other organization than it is to build a taxonomy of 
organizations and Chen decide if these organizational para«ters 
have anything to do with whether a particular Independent 
variable will work. 

Suggestions for the 1980' « 

«o«lt* f^"""! P^bably futile to attempt to specify directly the 

goals of various types of Naval organizations and proceed through 
multivariate criterion development, the following L^tatlv^ i^JSstlons 

are available. Since dependent variables (i.e., effectiveness criteria^ 
are used in the end to make decisions, it iould'be frTt^tl Zol lt ^ 
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effectiveness criteria in a decision making framework and from a process 
point of view^^fter understanding this process, it should lead to 
better measurement of criteria and better decision making. Consequently, 
the following kinds of studies would be helpful. 

. A thorough analysis should be made of how the decision r^rs 
or power centers in a variety of Naval organizations use the 
<^^"^^t measures of criteria, whatever they might be. That is, 
what kinds of decisions are actually made on the basis of 
existing effectiveness data? Case studies of actual decisions 
could be carried out and policy recapturing techniques could be 
applied to both real and simulated decision situations. 
Concomitantly, decision makers could be asked about the kinds 
of information they wished they had. This should give a better 
idea of what the powers that be want measures of organizational 
effectiveness to be good for. 

. Si|ice it doesn't seem Uke a good idea to commit R&D resources 
to a large scale study of many organizational units using a 
multivariate approach, it might be wise at some point to identify 
a few organizations or subunits that everyone agrees are 
effective and a few which everyone agrees are ineffective and 
conduct intensive case studies of each, looking for similarities 
and differences on variables like those in Table 1. Glaser and 
Tayxor (19/3) used such a technique to diagnose what makes an 
R&D organization effective and it appearied to be a valuable 
effort. 



. Regardless of whether a goal or systems model is adopted, it is 
a truism that the organization operates on goals of some sort, 
even if they cannot be verbalized and are fragmented across 
subunits or organizational decision makers. There are indirect 
techniques for articulating these goals aad it would be 
worthwhile to train people in Naval organizations to use them 
to determine the types of goals on which they operate. More 
importantly it would also have the effect of revealing to the 
relevant decision makers more of the processes by which they 
operate. In the end, the procedure to be taught might have 
some or all of the following Ingredients. 

A critical incident procedure could be used in which 
various subgroups in an organization would be asked to describe 
specific examples of effective and ineffective organizational 
performance. Commanding officers could do it, non-commissioned 
officers could f'.o it, enlisted men could do it. The descriptions 
obtained from each group could be subaJLtted to a qualitative 
cluster analysis-by various groups of judges to infer the 
operative goals chat seem to be represented. 
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A second skill would be the ability' to collect ob^d^ations 
of actual decision makers* behavior. Tliese observations cquld 
also be submit ^ed to a qualitative dinenipional analysis. The 
overall question is whether the goals of •fthe organization can 
be inferred from the way the powers that be reacted to problens, 
requests, and other stimuli. 

In sum, it would be valuable if a research effort could 
develop some relatively efficient techniques that Naval 
organizations could use themselves to self-^Uagnose their 
pperative goals. That is, by means of critical incident and 
policf recapturing techniques, asaisted perhi^s by a bit of 
process consultation (ala Ed Schein) it shobld be possible to 
determine what operating goals are beinj used and how they 
are being used and make thl^ information a regular item of 
feedback. 

. ''^ 

3. Since it; m^y ind^d l^e extremely difficult to specify all the 
^d gm and ^ th at are'bfade on an qtg^zatlon (since some of the most 

l^ortant occdr only rarely) and develop stral^tforward standardized 
^ criteria for how well these demands arc being met, it is felt that 
it %^uld be effort well spent to concentrate Instead on developing 
standardized measures of so--called system integrity. Thmt is, some 
method will have to be used to elicit from the relevant parties, a 
judgment as to the components that make up an effective system and then 
develop criteria measures for these co^ionents. The paper by Professor 
Milkovich explores this issue further. 

C, Looking over tlie^ laundry lists of independent variables one can 
see a nudber of handles that have shown to be promising in other 
organizations and on which the Navy could begin its own developmental 
work. The areas we would consider to be the most promising are: 

. The question cf whether or not individuals understand their own 
task goals and whether goals are stated in specific concrete 
terms. Both the work on Management by Objectives and by Ed 
Locke in the laboratory strongly suggest that '*knowlng «ihat to 
do" is a powerful determinant of behavior. 

. If various jobs in the Navy can be carefully described and the 
description used in recruiting to create a very accurate picture 
of what the individuals can expect (instead of over or under 
selling) will it result in new personnel who are more **coflad.tted" 
to the Navy^ have higher retention rates, and perform 
satisfactorily? That is, can self-selection improve upon 
organizational selection? 
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In either the private or public sector^ there have been very 
few in<-depth studies of what outcomes individuals actually 
seek from a job. Studies of job satisfaction most often 
sample their item content from almost everywhere except the 
job incumbents themselves. It would profit the Navy to do' 
such a study from the ground up and not imedlately ji^ to 
a questionnaire study which imposes a structure on the 
respondents. 
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FOOTNOTES 



Preparation of this paper was supported by the Navy Personnel Research 
and Development Center under contract nuoAier N00022-73-C-0023. 

Much of the literature search was carried out by David. A. Bownas and 
Norman G. Peterson, I am deeply In their debt. 
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MODELING, MEASURING AND MONITORING ORGANIZATIONAL EFFECTIVENESS 



George T. mikovich 



The content of this paper is based upon a review of the literature 
related to the feasibility and desirability of developing a personnel 
status index. (Dunnette, Milkovich, Motowidlo, 1973). The review high- 
lights the potential overlap in 

. the meaning of organizational effectiveness concepts found 
in several different fields of study 

. the approaches to measuring these unit effectiveness concepts 
in various disciplines * 

. the uses that are proposed for monitoring unit effectiveness 
The Meaning of Organizational Effectiveness 

Organizational effectiveness as a concept is found in the literature 
of several fields. Organization theorists in sociology and psychology 
discuss and attempt to measure it. Military managers have long considered 
a similar notion, readiness; economists and the human resource value 
literature discuss a concept called value; and macro-sociologists and 
eponomists are currently developing social indicators of various govern- 
mental and public units such 33 the quality of life and education. 

The socio-psychological literature does not contain a universally 
accepted meaning of effectiveness of organizational units. (Katz and Kahn, 
1966; Mahoney, 1967; Price, 1968; Ghorpade, 1971). It is generally defined 
as an organizational unites goal accomplishment. The literature, however, 
generally distinguishes between a rational-goalistic and a systemic model 
or organizational .effectiveness. 

The goalistic model defines effectiveness by comparing organizational 
goals to actual outcomes. This definition focuses the measurement of 
effectiveness upon identifying the units' goals and actual outcomes. The 
literature suggests no single set of organizational goals but instead a 
hierarchy of goals similar to Thomdike's (1949)- hierarchy of performance 
criteria: ultimate, intermediate and immediate goals (Georgopoulos and 
Tannenbaum, 1957; Mahoney and Weitzel, 1969). Seashore and Yuchtman (1967) 
for example, state that certain aspects of organizational effectiveness 
(such as production cosls) carry the burden of short-term demands in order 
to sustain the longer run potential (such as share of the market). The 
mid-range goals (intermediate and immediate) tend to be the ones, however, 
that policy makers typically use in assessing unit effectiveness (turnover, 
productivity, billet vacancies). 
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The systemic model defines effectiveness as the state of the Inter- . 
nal processes by which resources (Inputs) are procured from the environ- 
ment and outcomes are produced. An effective organization Is one that Is 
adaptive enough to procure resources and provide outcomes In such a manner 
as to remain In equilibrium. An effective unit Is a robust and adaptive 
one. (Etzlonl, 1960; Seashore and Yuchtman^ 1967). 

Military managers have also developed a concept of organisational 
units effectiveness. Hayward (1968) defines effectiveness (mllltary-army 
combat) In terms of three variables; the unit's capabilities, human and 
matetldl resources; the environment, weather* terrain, and vegetation; 
and the nature of the mission, the territory to be gained or held, within 
some t±m^ constraint, at a maximum allowable cost. Combat effectiveness 
of a unit is a function of the probability of success in combat, the 
capability of a friendly force, the capability of an enemy force, the 
environment, and the mission. 

» 

Another similar concept used by the military is readineso. Naval 
readiness was widely discussed and studied in the 1960's. Several task 
force and consultant reports dealt with the problems associated with the 
concept's meaning, measurement, and reporting systems (Popper and Miller, 
1965). An attempt to "unify the language of readiness" provided the 
following definitions: 

• Readiness - Predicted ability to accomplish those missions 
for which the unit is equipped and manned, or which have 
been assigned for accomplishment. Steadiness is the 
Summation of performance, endurance, and preparedness. 

• Coiifcat Readiness - Readiness to accomplish missions involv- 
ing physical combat. 

• Readiness for Non-Combat Missions - Readiness for accomplish- 
ment of missions not necessarily involving physical combat. 

• Operational Readiness - The sunmation of Combat Readiness and 
Readiness for Non-Combat missions. 

. Capability - Collective term denoting the design character- 
istics of available equipment or specifically equipped units. 
Equipment capability should not be desctibed by the use of 
qualitative adjectives, such as "high", "low", "unsatisfactory", 
"excellent", etc., without indication of the standards of 
comparison. 

A 1965 survey of the Navy's readiness reporting systene found five principal 
cfomponents of overall Naval operational readiness: material, personnel, 
training, endurance, assignment and location. (Management Research and Con- 
sulting Division, Clark, Cooper, Field, and Wohl, Inc., 1965). The survey 
wao part of research to develop the METRI (Military Essentiality Througjh 
Readiness Indices) systems for improved allocation procedures or policies 
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for material resources. Based upon the above discussion, a "ready unit" 
is one that acconqplishes the goals for which it has been equipped and 
manned; similarly, an "effective unit" is one that accomplishes its goals 
and/or adapts and maintains itself. 



The Navy ought to consider what differences, if any, exist between 
its Concept of readiness in which a considerable expenditure has already 
been made and the organization theorists* concept of effectiveness. A* 
distinction may lie in that readiness is more goalistic, results oriented, 
while effectiveness can also be described in more health, status or process 
oriented terms. 

In addition to organization theorists and military planners, other 
fields have concepts similar to organizational effectiveness. Applied 
economists, using the country as an organizational unit, assess the state 
or effectiveness of the country's economic activities throM^ several 
indicators. For example, current employment conditions are reflected by 
employment levels, unemployment and participation rates, job vacancies, 
and labor turnover. Prices and cost of living conditions indices are 
generated, as are wage rate, productivity rates, accident and work 
stoppage rates. 

These data are collected via survey and legally required reports. 
The indices' shortcomings and limitations have been well documented, 
(president's Committee to Appraise Employment and Unemployment Statistics, 
1962, Wolfbeln, S. L. , 1964). Changes in these and other economic 
indice*' are used to describe the state or "health" of the economy and to 
^evalua e the effectiveness of various monetary and fiscal programs. 

Probably the best known present day economic index of the country's 
effectiveness is the GNP. The GNP is the exchange value (price) of the 
newly produced gooda and services that are not resold in any form during 
the period under study. Published by the Commerce Department, the GNP 
is a measure of the flow of final output resulting from the economic 
activity of the U.S. during a selected period at current prices. Ihe GNP 
has we 11- recognized limitations and shortcomings. Macro-economists are 
ciirrently grappling with the notion of the GNP's "construct validity" as 
an index of the effectiveness of country economic growth. Modem economic 
thought is advocating adjusting the GNP measure to achieve a more meaning- 
ful measure of value which is called net economic welfare (NEW). 
(Morgenstem, 1963). The NEW measure attempts to account for factors 
omitted in GNP, such as the damage caused to the environment by generating 
additional kilowatt hours of power and the value of a homemaker's services 
in the household. 

The human resource value (HRV^ literature was reviewed as part of the 
project pertaining to the desirability and feasibility of developing a 
personnel status index. The HRV literature discusses the assessment of 
people as organization resources. (Flamholtz, 1971, 1972; Llkert and 
Bowers, 1969). An individual's value to an organization is the present 
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worth of the set of future services that Individual la expected to provide 
during the period he la anticipated to be with the organisation (FlairiioltZy 
1972) • While the literature does not dltectly Include the aaaeaaatnt of 
organizational unit activity » a unit* a value to aome larger organization 
may be considered as the preaent wfirth of a future atrean of aervlcea that 
the unit la expected to provide during the period under conelderatlon^ 

A final exaq>le of the Interdisciplinary nature of organizational 
effectiveness concepts can be found In ojacro^aoclo-econoBlc literature* a 
current Interest In social Indlcatora. ^Cartter, 1966; Baur, 1966; 
Management Science^ 1973} • ^ 

A social Indicator la defined aa an aggregate welfare aaaaure^ a 
statistic that aeasurea the extent to i*lch aome goal of general Intereat 
has been achieved (Wilson, 1970). The following qiMitatlon hl^llgjbts the 
need for Indlcatora of the status of auch phenomena aa the quality of life 
and the quality of education. 

**For many of the Important topics on which the public administrators 
and decision makers blithely pass Judgment and on which policies 
are made, there are no yardatlcka by which to know If thli^ are 
getting better or worse". (Baur» 1966) 

Quality, like organization effectiveness In an operational aenae, la 
someone^s subjective aaaessiaent; In essence, an attribute of value. Quality 
of life, quality of education, and other social Indlcatora have consldersble 
^po.tentlal to aid declalon makers In such actlvltlea aa evaluatlcm policies, 
auditing programs, monitoring trends, and aiding individuala in peraonal 
decisions. | 

These brief lllustra^iona from the literature of diverae, yet related 
fields of study, reveal the overlap In the meaning of organizational unit 
kffectiveneas. Those interested in understanding, analyzing, and explaining 
organizational effectiveness by necessity should consider an inter^diacipli- 
nary view. A universally accepted model of organizational effectiveness 
cannot be found in the literature. Any organization must decide just what 
It is attempting to model.- Is the phenomenon unit accompllahmant, likeli- 
hood of accoavlishment, or statua or health of internal processes? A related 
question the Navy must anawer is one that waa raised earlier; how, if at all, 
does unit effectiveness differ from the unit readineaa indicea now being 
monitored? 

The Measuring of Organization Ef fectiw.-^^ 3S 

The procedures for constructing any indicator of unit effectiveness, 
be it in economics, psychology or, sociology, csn be abstracted to a point 
%^ere several common Issues emerge: ^ 

. selecting elements to include 

• measuring these elements 
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establishing weights for the eleaents 



• determining the units to assess 

• monitoring, data collection 

. assessing the uscsfulness or validity of the index 

This section briefly discusses s<nne of these issi^ and illuiitrates soae 
of the unit effectiveness indices that have been developed. 

The literature reviewed for this paper suggests that selecting . 
eJ-'jients to be included in the unit effectiveness neasure is done by 
either prescribing the eleasnts or by eliciting the iaplidt elsMnts of 
the curnmt: decision makers models. For example, Georgopoulos and 
Tannenbaum (1957) in a studv of the unit effectiveness of 32 retail service 
units prescribed unit effectiveness to be a function of productivity/flexi- 
bility or successful adaptation to externally Induced changes, and absence 
of intraorganizational strain or conflict between organizational subgrouptf. 
Hayward (1968) also prescribed military unit effectiveness to be some 
function or performance, endurance and preparedness. 

The current state of knowli^dg^ is not advanced to the level where the 
elements of unit effectiveness can confidently be prescribed* Inste^^d, 
model eliciting methods that capture the implicit models of decision mskers 
can be used. Whenever budgets are generated, projects and tasks assigned 
and resources allocated, mana^rs make judgments (eiq)licitly or liq>licltly) 
about the relative ef fectivei^ss of subordinate units. Managers and officers 
«re themselves sources of elements making up organisation effectiveness* 

There are several examples of model-eliciting in the unit effectiveness 
literature. Mahoney and Weitzel (1969) in their studies of organizational 
effectiveness generated llA elements of effectiveness culled from the 
literature and discussions with managers. Descriptions of 283 units on the 
llA elements from 84 managers In 13 firms were obtained. The managers per- 
ceptions of the degree that each element was descriptive of a subordinate 
imit were factor analyzed to identify the basic dimensions of effectiveness. 
Their approach is essentially capturing the elements used by managers In 
describing effective units. In contrast. Seashore and Yucbtman (1967) 
factor analyzed a set of actual performance indices (compared with Mahoney 
et. al's use of nanagerlal perceptions) of 75 sales agencies in one insurance 
firm over a 10-year period. Ten dimensions of effectiveness were found. 

There are other approaches for eliciting models used by managers. 
Critical incidents gleaned from Naval managers who recall essential dif- 
ferences between effective and ineffective units could be used. The delphl 
procedure whi systematically uses expert judgment to develop an answer to 
some question could also be considered. (Dalkey, 1967; Mllkovlch, 1972). 
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The delphi has been used extensively in forecasting, .e.g. , 
the structure of fringe benefits in the year 2000 or the 
eonblnatlpn of nuclear devices it would take to reduce an-, 
adversary's industrial capacity to 1/3. The delphi panel 
comprised of Naval decision makers could be asked to judge 
the effectiveness of a set of Naval units • The information 
bits these experts requested to make their decision should 
reflect the items upon which effectiveness judgments are 
made and in this way elicit the decision elements of the 
managers. 

The elements included in social indicators of unit effectiveness, such as 
the quality of life among the states or the quality of universities graduate 
education were d«awn from expert judgment • The goals of national quallty-of- 
life generated in the Report of the President's Commission on National Goals 
were selected as the key elements for tfie quality of life index* 

In sum, the elements to be included in any indicator of unit effective* 
ness can be prescribed from the current state of knowledge or elicited from 
decision makers. Considering the current level of knowledge and the poten- 
tial increase in acceptability, it appears that the Naval officers and 
managers should be the primary source for the elements -of the index» 

My review of the literature shows that the measurement of these elements 
depends upon the variable being measured and the discipline of those doing 
the measuring. At the risk of over siiq>lification, it seems that economists, 
accountants and management scientists tend to be overly concerned with 
administrative feasibility and costs of measurement, while the behaviorallst 
tends to forsake the business at hand, i.e., to develop an index of unit 
effectiveness for lengthy discussion of reliabilities atid validities of 
their measures. 

f' 

Hayward (1968) in his article on military uhIl effectiveness meaaure- 
ment suggests 3 basic approaches to operationallzing variables. Measurement 
can be based upon actual samples of performance and behavior of the units 
under real or simulated situations such as war games; upon signs or proxies 
of effectiveness such as the authorized billet strength minus the actual 
billet strength of a unit or the level of training received; and tq>on intui- 
tive judgment. The latter method is most commonly used by managers. Several 
methods of systematically eliciting judgments have alrea^ been discussed. 
Obviously, the only way to truly measure effectiveness of an organization of 
any kind is through the analysis of data on its performance under actual 
operating conditions. 

A few illustrations of how some of the unit effectiveness concepts 
have been measured may be helpful. 

METRI ; (Popper & Miller, 1965) 

A unit personnel readiness index was proposed to the Navy in 1965. 
The Military Essentiality Thropgh Readiness Indices (METRI) personnel 
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system generated a measure on a zero-to-one scale for the capability of 
a unit to uieet requirements of some assigned missions for a given period. 

The basic model of the METRI is simply: 
where 



= "TEAM" or unit personnel readiness 

« the estimated value of a fully qualified ("ready") 
team meofcer 



« the estimated readiness of a team member to perform 
assigned duties 

Hie key concept of the MET^d method for determining personnel readi- 
ness is to compare the actual human resources In tezM of the nuiri)ers and 

^"^"^ desired (as authorized by Naval Manpower Authorization 
NAVPERS-576) state* 



_t. The basic instrument fc measuring personnel readiness 
is at "readiness matrix"— shown in the figure on the next page. 
The matrix singly compares the actual to authorized level of 
personnel. The cell entries are the degree of readiness (on a 
zero to one scale) an individual possesses to fulfill the func- 
tions requirements. For exai^le, if a given job for which SCPO 
(Senior Petty Officer) is required (according to NAVPERS-576) 
is actually performed by a POI (Pretty Officer i) , personnel 
readiness is .85. If a POI is required, but an SCPO actually 
performs the function, then readiness is .95. The procedures 
for determining the cell entries, readiness, are not discussed 
in any detail~"this was designed with the aid of personnel in 
BuPers on a judgmental basis" (Proper and Miller, 1965). 

j( 

JL^. The weighting factor denotes the relative importance of 
each wetsbej^^j^ the unit to the accomplishment of the unit's 
missions. For example, a Chief may be assigned a wei^t of .11 * 
while a Boilerman Third Class m^ receive a .04. The total sum 
of 'a unit's 'K Factor'" should add up to 1.00. The factors 
were derived on a judgmental basis from conversations with Kavy 
operating personnel (Popper and Miller, 1965). 

The values in the readiness matrix are estimates expressing the amount 
of readiness lost due to allocations below authorized levels. This assumes 
authorized levels are the optimal staff level. ^ It also assumes that all the 
relevant variables related to personnel readiness can be represented in the 
three elements of this model: the numbers and ratings of personnel and 
their "K values" of relative contribution to their unit's missions. 
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Organizational Effectiveness 

Mahoney and Veltzel (1972) have developed a questionnaire based on 
their studies of managers* perceptions of organizational effectiveness 
discussed earlier. 

Each organization unit Is described on the nineteen factors derived 
from their earlier work. Each of these factors Is in turn made iq) of 2 
or 3 Items (58 In all). For example^ the factor. Results Emphasis Is 
assessed by the following Items: 

Short-term results^ are emphasized In the unit 
Rarely 1 9 Usually 

Supervisors are more concerned with what Is 
accomplished than methods used 

Always 9 . 1 Hever 

S'upervlsory emphasis give to prediction as a 
goal 

The manager Is then asked to rate the overall effectiveness of the 
unit relative to all other units he may have known. 

Social Indicators 

These are several examples of social Indicator measurement. (Cartter, 
1966; Wilson, 1970; Management Science, 1973). The quality of life Indica- 
tors developed by the Midwest Research Institute Illustrates the general 
nature of the measurement. (Wilson, 1970). The quality of life studies 
profiles each unit (states In this case) on the following nine factors: 

• Individual status - Enhancing personal dignity, promoting 
maximum development of capabilities, and widening the 
opportunities of Individual choice. 

• Individual equality - Eliminating discrliBi.iatlon on the 
basis of race. 

• State and local gov mment - Developing an Informed and 
involved citizenry, improving the quality of public 
administration, increasing collaboration and the sharing 
of power among all levels of government, and liq>rovlng 
the professionalism of state legislatures. 

. Education - Iiqproving the quantity and quality of education. 

. Economic growth - Increasing both the quantity and quality 
of growth. Including capital investment in the public sector, 
improving the standard of living, and providing education 
for ^ more capable and flexible work force. 
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• Technological change - Increasing the effort in research and 
the availability of manpower and facilities to maintain 
economic grovth and improve living conditions. 

. Agriculture - Improvimg the quality of life in the agricul- 
tural sector of our economy. 

, Living conditions ^ Alleviating general poverty and the 
decayed conditiras of the cities. 

. Health and welfare - Inqprovlng the levels of welfare assis- 
tance, vocational rehabilitation, and provision of medical 
services in both the public and private sectors of the 
economy. 

A definition of one of the factors. Individual Equality, developed as 
part of quality of life studies, illustrates the types of measures used. 
Individual Equality was defined as three variables of current economic 
status, current economic discrimination, and socio-economic impairment dis- 
crimination. The model takes the following form: 

1 . a^X^ + b2X2 - C3X3 

Soclo-Economlc Indicator for Individual Equality 

'S.: Current Ec o nomic Status 

^1: ratio of nonwhite to wfai|:e per capita median 
income adjusted for urban-rural differences 
in population distribution. 

^2: ratio of nonwhite to white esftloyment rates. 

Current Economic Discrimination 

^1: ratio of nonwhite to white income adjusted for 
occupational, differences. 

^2: ratio of nonuiiite to %ihite income adjusted for 
educational differences. 

Y 

3: Socio-Economic Impairment Discrimination 
education 

^31: educational attainment as measured by the ratio 

of the white to nonwhite high school dropout rate. 
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educational attainment as measured by the ratio 
of nonwhlte to white college graduate rate, 

educational quality as measured by the ratio of 
white to nonwhlte percent of draftees who failed ' 
the mental requirements portion of their pre-ln- 
ductlon examination, 

health 

ratio of white to nonwhlte age adjusted mortality 
rates. 

environmental conditions ^ 

urban housing density as measured by the ratio of 
vhlte to nonwhlte percent of occupied urban hous- 
ing units which are sound and have all plumbing 
facilities. 

quality of urban housing as measured by the ralto 
of white to nonwhlte percent of occupied urban 
housing units which are sound and have all plunblng 
facilities. 

segregation of urban housing as measured by a 
weighted Index of the extent of segregation by 
census block. 

The Investigators provided a brief discussion of alternative meaning to 
individual equality and settled on a definition consistent with the data 
which are available for analysis. Note also, an Independent criterion measure 
of equality was not considered. 

» 

There are several other issues related to the development of an indi- 
cator of organizational effectiveness. Should a single composite index or 
a profile made up of several characteristics be generated? A profile, it has 
been argued, has greater diagnostic power. On the other hand, single indices 
seem to enjoy greater acceptability and visibility. The issue is essentially 
one of devising a procedure for establishing importance weights for the 
elements to allow them to be cood[>ined. A related illustration of this issue 
of single vs. multiple indicators can be taken from the work on social indi- 
cators. Minnesota dropped in rank of overall quality of life from 2nd in 1972 
to 13th in 1973. Once the drop was announced, the inmediate question from 
government officials (especially tourism Interests) was why. The cause of 
this drop was a change in the proportion of corporate to family farms in 
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'Minnesota and the fact that the index developers had simply averaged the 
scores on all the factors to provide the popular press with some figures/ 
The developers later back-tracked and pointed out the inherent weakness 
in the overall ranking generated by combining such diverse factors that 
were thenselves composites of diverse factors. 

Another' issue related to the development of a unit effectiveness 
measure is exactly what units should be assessed? At what levels of 
organizational functioning should an effectiveness index be calculated: 
work teams, ships , several ships? Other areas of study have based these 
decisions upon two criteria: the availability of coo^arable data and 
meaningfulness of the unit for the indexes' potential uses. 

A final issue is the validation of an index of unit effectiveness. 
Validation of any measure involves testing and elaborating it. The index 
would be validated like anything else; i.e., by exploring the logical 
network of relations that such an index should eidiibit and then see to 
what extent these expectations are realized. Bond (1973) suggests such 
strategies as having senior connand people nominate the best ship and shore 
units and see if the units have high effectiveness scores or coiq>aring unit' 
operational exercise performance ratings to effectiveness scores. Valida- 
tion is a .long term, interative process , with several atteii4>ted uses, 
elaborations and modifications. From the research — management stance, the 
validation effort is an attenqit to explicate the meaning of the index, to 
provide some evidence of its stability, logical consistency and practical 
usefulness. (Dunnette, 1966). 

Conclusion 

In summary, a wide range of measures is being developed for concepts 
very similar in meaning and potential uses, to organizational effectiveness. 
Measures based upon human judgment range all the way from asking persons 
to describe their organizational environmei&t , to assessing how well a task 
has been performed, to requiring estimates of the amount of "readiness loss'* 
that is contingent upon understaf fing a unit. Compared to assessing the 
"quality of life" in the various states, the task of developing a reasonable 
index of organizational effectiveness seems very possible. 

There are several meaning, measuring and monitoring issues related to 
the development of such an index. They need to be resolved. Effectiveness, 
readiness, status, value, quality, may all reflect an interdisciplinary 
interest in the "health" of an organizational unit, be it a state, the 
country, a ship or a work team. 

The spurt of interest in organizational effectiveness in the 60's has 
not yet resulted in the formulation of a universally acceptable, methodology 
for assessing organizational effe :iveness. Several potentially useful 
approaches have been discussed in this presentation. Pilot studies of 
several of these approaches could be considered. Finally, any research in 
this area ought have as one objective, the insurance that any effectiveness 
indices that are proposed bo administratively feasible. Another elegant, 
elaborate mechanism, that few understand will get subverted by the eventual 
uses. 
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SOCIAL-PSYCHOLOGICAL INDICATORS 
OF ORGANIZATIONAL EFFECTIVENESS 



Jerome L, Franklin 

One principal reason for focusing upon indicators of organizational 
effectiveness, whether they are of a social-psychological nature or not, 
IS to enhance the possibility of increasing the effectiveness of organiza- 
tional functioning. Especially useful is information which can be compared 
with normative and/or ideal states to indicate areas in which there exist 
strengths and weaknesses. Such evaluations can result in detailed pictures 
of organizational functioning which will be useful for improving the 
organization through a matching of ineffective organizational con- 
ditions with appropriate corrective activities. This information has 
potential value in any organization but can be of special interest and 
value to organizations faced with major change initiated from within 
or imposed from without. An example of the latter for the Navy is the 
chanrge in naticnal policy from a system of military conscription to the 
all-volunteer forces concept. Such changes create relatively high levels 
of need for information about the changing effectiveness of organizational 
functioning. 

Inadequacies of Available Indicators ^ 

Almost all organizations regularly gather information which is 
thought to relate to organizational effectiveness. Traditionally > this 
information has focused upon organizational outputs in terms of volume^ 
efficiency, quality. A number of other indicators are also often considered 
by organizations because of their assumed relationship to such output 
measures. Examples of these indicators include satisfaction, absence 
rates, accident rates, total variable expenses, greivance rates, and more 
recently, a variety of indicators of individual physical health. Although 
of some interest, these measures are not particularly useful for suggesting 
appropriate actions for correcting problems resulting in ineffective 
organizational functioning. Several reasons account for this: 

• The information is often gathered for purposes which 
promote distortion and inconsistency in computation 
methods. Meaningful comparisons are difficult to 
obtain when computalion practices change to respond 
to external (taxes, stock holders) and internal 
(reward decisions) pressures. 

• The information seldom indicates tb se weaknesses which 
can be corrected directly. Rather, the information 
provides an indication of the result of a multitude of 
behaviors and conditions which have interacted to trans- 
form organizational inputs into the measured outputs. 
Like body temperature, the information may indicate the 
existence of a problem in the system but will not help 
locate the site of the problem. In large organizations 
like the Navy, the system is qvite complex and the causes 
and locations of alterable conditions may be extremely 
difficult to identify. 
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• The information typically available In organizations 
presents indications of effectiveness late in what Is 
often a long and complex sequence of events. Thus, even 
if this information could serve as the basis for taking 
corrective actions in early elements of the sequence, the 
damage has, in a sense, already been/done once the situation 
becomes evident through these Indicators. 

Thus, a general problem faced in many organizations attempting to 
improve organizational effectiveness is that there Is a' lack of Information 
useful for naking meaningful corrective decisions. When available, the 
information is often Inaccurate, unstandardized, and provides little 
insight into basic alterable conditions and the manner by which they 
relate to organizational outputs. Faced with only this type of informa- 
tion one is left without a manner by which action can be taken to improve , 
organizational functioning through the systematic identification and correc* 
tion of weaknesses in organizations. ' * 

Advantage^, of Social-Psychologica] Indicators 

Partially, in an attempt to gather more useful iiiformation for the 
purpose of systematically improving organizational functioning, there 
has been an increasing interest upon social*psychological aspects of 
organizations. Among these are such aspects as leadership, decision- 
making practices, influence pat^tems, motivational conditions, and 
communication patterns. An important reason for focusing upon these var- 
iables is that they are thought to be causally prior to organizational 
output variables. That is, they effect many of the criteria judged to 
he important indicators of organizational effectiveness or success. 

Models of Organizational Functioning - 

As the above statements suggest, models of organizational functioning 
have been developed which identify and causally relate major social-psy- ^ 
chological factors to one another and to other factors. Although these 
models are not complete or udequivocally supported by empirical evidence, 
some arc adequately descriptive and supported to be judged useful. 

A quite simple example of such a model is presented in Figure 1, 
The figure suggests that organizations obtain energy (inputs) from the 
environment which are acted upon and transformed (throughputs) to 
o^itcomes (outputs). As the model indicates, outputs can be conceived 
as either individual or organizational. The model also suggests both a 
temporal and causal sequence — i.e., inputs precede and affect 
throughputs; inputs and throughputs shape individual outcomes; and, 
all three of these categories determine organizational outcomes. , 
Feedback is suggested by the dashed lines tb indicate that some 
reciprocal influence also exists. 

In this model the social-psychological indicators fall mainly 
in the "throughput" category. For example » in the vrork at the 
Organizational Development Rerearch Program at the Institute for 
Social Research the following factors receive extensive attention: 
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• Supervisory Leadership 
Supervisory Support 
Supervisory Goal Emphasis 
Supervisory Team Building 
Supervisory Work Facilitation 

• Peer Leadership 
Peer Support 
Peer Goal Emphasis 
Peer Team Building 
Peer Work Facilitation 

• Group Process 
Group Decision-Making 
Confidence and Trust in Group Members 
Adaptability of Group 

Effectiveness of Planning and Coordination 
Motivation of Gr^up Members to Meet Objectives 
-' ^ Sharing of Information between Group Members 

• Organizational Climate 
Communication Flow 
Motivational Conditions 
Decision«»Making Practices 
Human Resources Primacy 
Lower-Level Influence 

Although not indicated » these social-psychological indicators 
within the throughput category of the model in Figure 1 can also be 
related to one another in a temporal and causal manner. Thus, a more 
complete model would specify relationships between the indicators fal*-^ 
ling within the throughput category. Although such models exist, 
empirical support of them is just beginning to emerge. 

Information Gathering 

A second major advancement with respect to the social-psychological 
factors is the development of methods which make the gathering of informa- 
tion about these factors relatively simple. An example of a tool used for 
.this purpose is the Survey of Organizations questionnaire developed at 
the Institute for Social Research (Taylor & Bdwers, 1972). This Instru- 
ment serves as a standardized tool used to tap many of the social-psycho- 
logical factors posited by models of organizational functioning. It has 
been used in approximately 40 organizations mostly In business and In- 
dustrial settings and has the advantages of both a theoretical base snd 
the availability of comparative data (norms) based upon 20,000 respondents. 
These norms provide standards for evaluating one organization or <tubpart 
thereof (e.g., level In a hierarchy) on the basis of comparisons to 
other organizations which have used the same lnstru!iibnt« 

One distinguishing feature of the Survey of Organization? questionnaire 
is that it focuses primarily upon the situation in which people function 
and their actual behaviors rather than the affective reactions of 
individuals to these situations and behaviors. ThiB focus suggests 
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an assumption noted below that If one Is to Improve organizational 
functioning, It is a least as important to utiderstand the causes of 
affective reactions ~ i.e., conditions and behaviors — as to identify 
the reactions themselves. 

Systematic Organizational Improvement 

A third major step toward using Information about organizational 
processes as the basis of improving effectiveness has been the develop- 
ment of techniques for systematically improving organizational function- 
ing. Although many techniques exist, the OrganizatiotAl Development 
Research Program has come to rely upon a general approach termed 
Survey-Guided Development which has as its basis the collection and 
evaluation of information about soclal-psychological factors related 
to organizational effectiveness (Bowers & Franklin, 1972). The informa- 
tion deemed most valuable in this approach is that which describes the 
P£h^yX9]^? of organizational members and the situations in which they 
act rather than the state of output factors. One important advantage of 
t!ie former is that they can be Influenced more directly through corrective 
activities than the outputs themselves. 

The Future 

It appears that we are rapidly approaching a situation characterized 
by two Important factors. First, the capabilities will be realized for 
gathering information about a multitude of factors of various types at 
many stages in a causal sequence which have known relationships to 
each other. For exan^le, some progress has already been made in 
empirically relating a variety /of social-psychological factors to each 
other and to output criteria (Bowers & Seashore, 1966; Drexler & 
Bowers, 1973; Ta/lor & Bowers, 1972). In the ideal state, the focvis 
of our Information gathering would be on those factors falling early 
in the' causal sequence such that corrective actions could be iiq>le- 
mented at the earliest possible time. 

The second factor of the anticipated state would be the routine 
CO* 'action of such Information such that it could be subsequently used' as a 
%as for (a) IdcntJLfying and defining strengths and weaknesses in 
organizational functioning » (b) matching basic causes of problems with 
corrective activities, and (c) evaluating the effectiveness of corrective 
activities in improving organizational functioning. 

Research Needs 

Four areas of concentration seem crucial to arriving at a point 
where these capabilities are realized. The first two are judged of 
primary importance and the latter two of lesser "rgency. First, there 
exists the need for the further identification of factors crucial to 
organizational functioning and the specification of their temporal 
and causal relationships. Little research-based information is nov 
available to support the relationships suggested by even relatively 
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simple models indicating such relationships. The greatest barriers to 
such studies may well be methodological difficulties which, to some 
extent, are currently beitig resolved* However, even with the most 
recent advances, it seems evident Lhat longitudinal data (probably from 
at least 3 waves of data collection) provides real advantages in 
the determination of temporal and causal sequencing. 

A second major area in need of development is knowledge with ^ 
^respect to the appropriate matching of the identified causes of problems 
with corrective activities to attain maximal improvement In organizational 
effectiveness. Recent work in this area suggests that th±s problem is 
more complex than generally acknowledged (Bowers, Franklin, & Pecorella, 1973). 

The remaining two ^reas are presented as lower priorities not because 
of fheir relative unimportance but rather on the basis of the relatively 
advanced state of current development. Three areas are (1) the further 
refinement of measurement techniques useful for measuring social-psychological 
factors, and (2) the further development and refinement of techniques use- 
ful for altering situations and behaviors related to organizational effective- 
ness. 

Applicability for the Navy 

There are many' questions related to the usefulness of this information 
to the Navy. Are the theoretical notions about other organizations 
also appropriate to Navy settings? Can the clesired information be 
conveniently gathered? Could the information be used in constructive ways 
to help solve organizational problems faced by the Navy? Based upon 
previous e;cperiences with large civilian organizations and current 
contacts ^rith the Navy as a contractor for the All-Volunteer Forces 
study, it would seem that each of these questions can be answered 
affirmatively. 

For example, from the All-Volunteer Forces study it was found 
that data about social-psychological factors of work settings was 
easily gathered both on shore stations and aboard ships. In fact, it 
proved feasible to collect information using a modified version of the 
Survey of Organizations from a good representative sample of Navy 
personnel around the world. Aside from a few relatively minor lof^istical 
problems, the data collection activities proved rather easy compared 
with some attempts to collect similar lata in ci 'ilian organizations. 
Respondents were generally conscientious and thotough in completing the 
questionnaires. 

Aside from the actual mechanics of gathering such information is 
the question of its validity — i.e., accuracy and usefulness. This 
is a more 4ifficult question but, the information available to date 
indicates that the data is at least reasonably accurate. Statistical 
analyses suggest that the consistency of measures is equivalent to 
what is expected in civilian populations. Further, anecdotal evidence 
lends credence to the findings suggested in a recent diagnostic report 
based upon this information (Bowers & Franklin, 1973). In short, it 
seems that the collection of information about social-psychological aspects 
of the Navy as an organization and sub-units as s^maller organizations is 
both possible and potentially useful, 
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Importance to the Navy \ 

Another vital question relates to the importance of these social- 1 
psychological factors to the Navy, Theory suggests the importance lies^ 
in tHe causal influence of such factors over more obvious and causally 
subsequent factors effecting or indicating organizational effectiveness* 
Previous>iy noted analyses based upon civilian data in fact have provided 
evidence Supporting the theory. For example, relationships have been 
found betweism one or more social-psychologicaJT factor and grievance 
rates, totalN^riable expenses, accident ^ites, and absence rates. 
Such data for bhe Navy seems largely ui/available. One exception is 
a recent study which examined the r-^^ij^'-^n.nct^jp ji^^t^o^n IC social*- 
psychological factors and retention rates aboard 20 ships and 2^ 
air commands (Drexler & Bowers^ 1973). The results of this limited 
study lends support to the notion that relationships do in fact exist 
between the kind of human or organizational system jtiHicated by the 
social-psychological measures and the retention rates of (Jies^ Units. 
The duplication of such findings for other criteria ~ e7g., performance 
ratings, cost of operations, quality of performance — would strongly 
suggest the importance of social-psychological indicators of organiza- 
tional effectiveness for the Navy. 
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PROSPECTS FOR RESEARCH ON ORGANIZATIONAL CLIMATES 



Roy Payne B.A. 



The aim of this paper is to present some suggestions as to how 
research into organizational climates should proceed during the period 
between now and 1980. Figure 1 shows the structure the paper follows. 
The paper offers alternative views of the future because the data from the 
first three steps in the flow diagram in Figure 1 reveal that the con- 
cept of organizational climate may not be viable. How to judge it to 
be viable becomes the first topic of concern. 

Evaluating a Concept or Research Activity . 

M Cartwright (1973) points out, "there are few established cri- 
teria for evaluating an entire field of Investigation, the critical 
issue of research significance tends to be relegated to the realm of 
intuition and subjective judgement", but few scientists would argue 
that science should aim at achieving one or all of the following: 

'1. an accurate and reliable description which may ultimately 
form the basis of some taxonomlc system 

2. the ability to predict the behaviour of the organism or 
system under study 

3. understanding of the way the organism or system functions. 

Before examining how well the concept of organizational climate and 
the research associated with* it has achieved each of these three goals 
it is necessary to try and define it. 

Definition of the Concept of Organizational Climate 

Collections of the various definitions of the concept may be found 
in Tagiuri and Litwin (1968) and Campbell et al (1970) • On the basis 
of an examiniation of these the author (Payne, 1971) has offered the 
following definition: "Organizational climate is a molar concept re- 
flecting the content and strength of the pr^alent values, norms, atti- 
tudes, behaviours, and feelings of the members of a social system 
which can be operationally measured through the perceptions of systa& 
members or observational and other objective means". The one distinc- 
tive aspect of this definition is t-he notion that climate can be 
measured by 'objective* methods* All the studies which have set out 
to measure climate have done so by asking a representative sample of 
the people in the organization to say whether certain statements about 
the organization are true or not. That is, climate is measured by the 
perceptions of the system members. It is suggested here that reliable 
indicators of norms, values and attitudes could be obtained through 
collecting statistics on absence, lateness, and labour turnover, by 
use of the critical incident technique, or by systematic observation 
of the behaviour of people in the system such as is done by Roger 
Barker and his colleagues (1963) in cheir studies of "The stream of 



28^9 



ni-4.1 



behaviour" and already applied to the study of organizations in their 
book, "Big School, Small School" (Barker and Gump, 1964). 

Another distinction which is implicit in the definition is that 
climate is different from the formal organization structure. Llkert 
(1967) for example defines the formal organization structure as an 
independent variable because it can be manipulated by management to 
alter the norms and attitudes of people (climate) which then has some 
effect on the end-result variables of output and performance. Con- 
ceptually then, structure is different from climate. This conceptual 
distinction has not always been maintained in the operational measures 
of climate. Campbell et al (1970) review a number of climate measures 
and conclude that there are at least these dimensions: 

1. Individual autonomy or the freedom of the individual to be 
his own boss and not having to be constantly accountable to 
higher management. 

2. Structure or the degree to which the objectives and methods of 
the job are established and communicated to the individual. 

3. General reward orientation or the level of rewards available. 

4. Consideration and warmth or support in a human relations 
sense* 

5. Co-Qperation vs conflict . ^ 

In a factor analysis of a large number of measures of organization struc 
tural variablesfcj Pugh et al (1968) report four dimensions of structure: 

1. Structuring of activities or degree to which roles are speci- 
fied, standardized and formalized. 

2. Concentration of authority or degree to which authority to 
take decisions is centralized at top of the organization. 

3. Line control of workflow or degree to which control is exer- 
cised by line personnel rather than procedures. 

4. Size of supportive component or percentage of non-productio;i 
personnel, percentage of clerks, etc. 

Campbell et al (1970) indicate that the first two climate dimensions, 
structure and autonomy, are very similar to the first two dimensions 
of organization structure. We wish to suggest that organization struc- 
ture too can be operationally measured by subjective or objective 
methods and .that the first two climate dimensions referred to above 
are actually better considered as subjective measures of the first two 
structural dimensions above. 

Figure 2 is taken from Payne and Pugh (1973) and presents examples 
of studies which have operationali zad the two concepts of structure 
and climate in these two ways. This fourfold classification was used 
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as a framework for reviewing the literature on organization structure 
and organization climate and the structure of the review appears below. 
It is presented to the reader to help elucidate the concepts and to In- 
dicate the origins of some of the arguments which appear in the present 
paper. 

Structure of Review of Literature on Organization Structure and Organi- 
zation Climate 

(a) Organizational structux^e and its concomitants, including 
subjective and ot>jectlve methods of measurement. 

(b) Organizational climate and its concomitants including 
subjective and objective methods of measurement. 

comparison of: - 

(c) Perceptual measures of structure and perceptual measures 
of climate. 

(d) Objective measures of structure and perceptual measures of 
climate. 

(c) Objective measures of 'structure and objective measures of 
climate. 

(f) Organizational climate and individual characteristics. 

(1) climate and other variables when the data are 
collected from the same individual 

(11) climate discrepancy scores and other variables 

when the data are collected from the same individual 

(ili) aggregate climate scores and aggregate individual 
attributes. 

Having established what we mean by organizational climate it is now 
possible to attempt to evaluate it against the three criteria previously 
listed; descrlption/classlf ication, prediction and understanding. 

Climate Evaluated Against Criterion of Description/Classification 

An essential requirement of any classlf Icatory system is that the 
basis on which the classification is made is readily verifiable by a third 
party so that two different people would arrive at the same classification. 
In the case of organizational climate this raises the problem of accur- 
acy as Guion (1973) terms it. That is, do different people agree that 
the climate is of a certain kind? Table 1 presents some data from Payne 
and Mansfield (1972) which suggest that people from different levels in 
organizations have differing views about the climate. The data were 
collected from fourteen business organizations which differed consider- 
ably in size and product. The Business Organization Climate Index (Payne 
and Pheysey, 1971) was administered to samples of personnel at all levels 
of the workforce. The sa» pies at the lower levels in the organization 
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are random but not representative in terms of size. Level O.in Table 1 
refers to operating level employees and level 4 to chief executive level. 
The intervening levels refer to supervisory and middle management T The 
column of F ratios in Table 1 indicates that there were significant 
differences on six of the eight scales^ by organizational level. Examina- 
tion of the mean scores reveals that generally speaking the higher one 
is in the organization the more favourably does one describe it. In 
other words there is not high consensus about the nature of the organiza- 
tion climate, and one cannot therefore treat a mean score as an accurate 
measure of the organization's climate. 

A legitimate criticism of Table 1 would be that the data are from 
different organizations, and there may be consensus in individual organi- 
zations. Table 2 presents data from virtually all the management and 
supervision in one company. This is a manufacturing company which em- 
ploys about 8,000 personnel. The table shows that the average mean size 
on each scale is about 4.0 and the standard deviation about 2.0. Given 
that these are 9 point scales, scoring 0-3, these means and standard 
deviations describe scales with a good distribution of scores covering 
the whole scale. There is little tendency to produce skewed or bunched 
c istributions which .would suggest that these managers and supervisors 
1 Hve ar agreed view about their organization: the scale of rules orien- 
tation is a possible exception. Again it is not possible to conclude 
that a mean climate score accurately represents the climates in this 
company. Other studies making the same point have been reported by 
Schneider and Bartlett (1970) and Gorman and Malloy (1972). 

On this basis alone we can conclude that measures of organizational 
climate do not provide an adequat** description of organizations which 
could be used to provide a taxonomic classification. 

Evaluation of Climate Against The Criterion of Prediction 

This section assumes that prediction entails the use of measures 
which are reliable, and have both construct and predictive validity. 
Each of these three viH be examined and predictive validity will be 
considered against two criteria: organizational performance and or- 
gani^ational job-satisfaction. . 

i 

i) Reliability : the various measures of climate show acceptable 
levels of internal reliability (approxima^*^ly 0.75). Test- 
retest *-*^-udies f^^e very rare. Payne and Pheysey (1971) re- 
port only one change cut of 48 possible changes over a 7 week 
period, all of ;^ich suggest these sort of measures have the 
properties of int^nal reliability normally accepted for re- 
search purposes even though they are a some way from being 
perfect. 

ii) Construct validity : construct validity is held to exist when 
the criterion measure relates to some other measure with which 
it could be expected to relate on theoretical or common-yense 
grounds. It was suggested earlier in this paper that organi- 
zation structure should relate to organizational climate. 
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Table 3 presents data from three studies where a measure of 
climate is related to three variables of organization scr^ic- 
ture. Tlie v^iriables in the three studies were measured in 
exactly the same way» and the climate measure was obtained 
from directly comparable groups of people; namely the senior 
executives in the comapny. On average this was 7-8 people 
in each company: The measures of structure were objective 
measures operat ionalized according to .the method described 
in Pugh et al (1968). Interpersonal-conflict was measured 
by four items rated on 5 point Likert scales and is des- 
cribed in Cliiid and Ellis, (1973). The study identified on 
Table 3 as Birmingham was carried out on 25 manufacturing 
companies located in the Birmingham U.K. area. The Ohio sample 
was carried out from Kent State University and the organiza- 
tions werp again all manufacturing in that general region. 
Details of both studies can be found in Inkson et all (1970). 
The third column of Table 3 contains results from a study of 
service and manufacturing organizations from all parts of 
Britain (Child and Ellis, 1973). 



Despite being 3 directly comparable studies Table 3 shows 
how unstable the relations between structure and climate 
are. The instability is unlikely to be ^ue to sample dif- 
ferences since the 'odd man out' is a different study ir 
each of the three rows. On this comparison of objective 
measures of structure and subjective measures of climate the 
construct validity of climate is called into question. 

Table 4 explores the construct validity of the concept by 
comparing relationships amongst perceived or subjective 
measures of structure ar.d subjective measures of climate. 
The data are taken from the same three studies described 
in the previous paragraph and the methods and measures are 
once again directly comparable. Child and Ellis describe 
all the measures in detail, but they are either Likert 
scales or semantic-differential ratings. The boxes represent 
relationships which appear to be unstable across the three 
studies. Relationships amongst the perceived measures of 
structure are very stable, but as soon as climate variables 
are used their relationships with structual variables and 
other climate variables seems to be quite unstable. Con- 
struct validity is poor. 

^'^^^ Predictive validity : when, organizations are the unit of 
analysis there are not many studies relating climate to 
measures of organizational performance and satisfaction. 
Stern (1970) has found high relationships between the mean 
dimensions of his College Characteristics Index, Intellectual 
Climate, and various measures of college and university per- 
formance. These appear in Table 5. These data are not too 
generaiizable, however, since it i^ almost a tautology that 
organizations which take in people with high intellectual 
standards also output people with high intellectual standards 
and in doing so create a climate wi;:h a high interest in in- 
tellectual matters. Other dimensions of the climate are not 
mentioned as relating to performance indices. 
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Pritchard and Karasick (1973) report a study where climate 
was related to measures of organizational performance and or- 
ganizational satisfaction. Table 6 presents correlations be- 
tween climate and performance and satisfaction using the 
organization and the individual as the units of analysis. As 
there are only 5 organizations in the study, rank order corre- 
lations were used to analyze the organizational data. The 
organizations were in fact 5 regional offices within the same 
organization and this means that performance data is comparable. 
The performance measures for individuals consist of supervisory 
ratings of overall performance. With only five organizations 
in the sample it is difficult to place much confidence even in 
correlations of 0.9, but the pattern of relations between cli- 
mate and effectiveness makes some sense. More effective organi- 
zations appear to have climates low on structure, high on flexi- 
bility and are decentralized. Conceptually we should regard 
structure and decision centralization as subjective measures 
of structural variables so that the only genuine climate rela- 
tionship is with flexibility-innovation. Taylor and Bowers 
(1972) also report a study of six organizations which show 
some' relationship between climate and performance, but as they 
observe, "Certainly this small finding is far from conclusive, 
it raises perhaps more questions than it answers." One question 
it raises is why measures with such poor construct validity 
appear to have some predictive validity. Aggregating measures 
to construct an organizational score which is then related to 
another variable is, as Guilford (1954) indicates, a tactic 
which requires the most careful inspection, and in this case 
a lot more data before such inspection could be thorough. 

To some extent Table 6 alerts us to the danger mentioned in 
the previous paragraph. When the individual is taken as the 
unit of analysis the relationships between climate and effective- 
ness, and between climate and satisfaction, are very different 
from those 'at the organizational level of analysis. As Bachman 
et al (1966) have recommended, when there are relationships be- 
tween two variables at the individual and aggregate levels of 
analysis it is necessary to partial out for the relationship at 
the aggregate level, before assuming that the relationship at 
the aggregate level really does contain something unique to 
that level of analysis. 

The level of analysis question is also relevant in another way. 
It is implicit in the Pritchard and Karasick work that organiza- 
tional climate has an effect on individual satisfaction; but a 
more parsimonious explanation of the relationship may be that 
satisfied individuals may see the climate in a different way 
than dissatisfied individuals. The danger is that data collected 
from individuals and analyzed at the individual level can be 
interpreted as saying something about the organizational level 
of an-^ lysis. This error is committed more blatantly by George 
and Bishop (1971) in a study of over 200 teachers form 15 differ- 
ent schools. They had measures of personality, organization 
structure and organization climate but all measures were provided 
through the perceptions of theindividuals. These data were 
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analyzed across the individuals but Interpreted as saying 
scoiethlng about organizations. Thus It Is Important to ^ 
keep the conceptual distinction's between different levels 
of analysis, and when they are maintained the correct 
methodology must be used to apportion the varlaiice between 
Individual and aggregate effects. 

Whilst looking at the relationship between climate and 
satisfaction it seems useful to raise two more connected 
Issues. The first is to do with the distinction between 
cognition aiTd affect. A person coiq>letlng a climate 
questionnaire is asked to describe how he sees the organi- 
zation. A person coiqpleting a job-satisfaction question- 
naire should be asked to say how he feels about or 
evaluates his job. Climate Is a descriptive measure and 
jobr sat is faction an evaluative me<^ure. Unfortunately, 
these distinctions have not been rigorously maintained in 
constructing the two instruments. The Cornell Job Descrip- 
tion Index is Intended to measure job-satisfaction yet it 
is a measure which Includes many descriptive statements. 
The authors did this quite deliberately and argued that 
ones description of a job will be strongly influenced by 
how one feels about it, and therefore reflects how one 
feels about it. This is unquestionably true for many 
aspects of the job, but not necessarily true for all 
aspects. This is Illustrated by the information in Table 
7 which divides the items in "The WorW Itself" scale of 
the JDI. The tabj.e also shows that the evaluative items 
correlate amongst themselves and with another evaluative 
measure of job-satisfaction — the Hoppock scale (Hoppock, 1935), 
but they do not correlate with the descriptive items* The 
descriptive items do not correlate witi' each other (are not 
a scale) nor do they correlate with the Hoppock scale. 
Here is at least one example when description and affect are 
not related. The relevance to studies of climate is that 
when measures of satisfaction (or climate) contain both 
descriptive and evaluative statements it is difficult to ^ 
know whether relationships between the two are due to 
communality of descriptive items or the effect of affect on 
perception. 

The second issue we^want to raise concerns the communality 
of content in measures of climate and job-satisfaction. 
Johannesson (1971) has content analyzed a numbet of measures 
of ellmaie and job-satisfaction and shown that there is con- 
siderable overlap. For example, both measures ask about 
supervision. His tentative conclusion is that climate is a 
duplicate of job-satisfaction. In a later article (1973) 
Johannesson attempts an empirical investigation of the 
question by examining the relationships between two measures 
of job-satiefaction (the JDI and the Science Research Asso- 
ciates index * SRA) and a 90 item organizational climate 
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measure* The items in each of the three measures were 
cluster-analyzed separately. This produced 8 JDI clusters, 
8 SRA clusters and 6 climate clusters. Cluster scores were " 
calculated for these 22 clusters and these then submitted 
to a further cluster analysis. Three of the five clusters 
contained scales from both satisfaction and climate mea*- 
sures. Johannesson concluded that there is 'substantial 
redundancy* in the two concepts, and that the relationships 
* could be interpreted as sa^^ing that 'satisfaction causes 

satisfaction/ 

JohannesSon's conclusions can be questioned on two grounds 
Firstly, the tueasures are conceptually dif ferent~one is 
descriptive and the other evaluative. The fact that the two 
sometimes, and only sometimes, correlate does not make this 
conceptual distinction redundant, but rather supports the 
construct validity of each. Secondly, the^ data do net 
justify the conclusion that there is substantial redundancy. 
Table 8 summarises the correlation matrix for the 22 clusters 
by showing the hi^est, lowest and median correlations among 
the three measures. Thus the average correlation between 
job-satisfaction and climate is about .3 and between the 2 
job-satisfaction measures is about •25. There is something 
like 30% common variance between climate and job-satisfaction 
measures^, but the predictable variance is only about 9Z and 
hardly seems to justify being regarded as substantial. Per* 
haps a more realistic interpretation of Table 8 is that the 
convergent and discriminant validity of the job-satisfaction 
measures is so poor as to make all this data difficult Co 
understand. Despite all these difficulties has the concept 
of climate increased our understanJing of how organizations 
function? 

Climate Evaluated Against the Criterion of Increasing Understanding 

From a strictly scientific viewpoint it might seem almost stupid to 
ask whether a concept that has such poor construct and predictive validity • 
has increased our understanding. Generally in science if one can predict 
and control phenotaena one can claim also to be able to, explain or under- 
stand the phenomena. In medicine, however, drugs are often used to control 
behavior and we can predict their effects, but we don't necessarily under- 
stand why they act in the way they do. Understanding is \ised here in the 
sense that Spranger (1928) used it. Understanding, unlike explanation, 
seeks no basic causality, but rather a "nexus" of meaning relationships. 
It is a complex theoretical act In which we grasp the inner, meaningful 
nexus in the life and actions of individuals (or organizations). 

The great novelists and philosophers have provided many examples of 
increasing our understanding of human behav r even thou^ they would find 
it as difficult as anyone else to predict anc control. In the field of 
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organizational psychology recent writings in organizational development 
by Bennis et al, (1968), Argyris (1970) and Lawrence and Lorsch (1970) 
seem to provide frameworks and descriptions of organizations which help' 
one to grasp how they function, and how one might go about coming to an 
understanding of them. These writings refer to hardly any experiments 
and many of the measures used are unreliable and invalid yet there is 
still a feeling of increased understanding from reading them. Has the 
concept of climate contributed to this understanding? 

A cautious answer would be, "To some extent", Tagluri (1968) 
suggested that one of the advantages of climate is that "it is a summary 
term which is uncluttered by its individual exponents and this encourages 
the production of generalizations," In practice the concept is multi- 
dimensional and generalizations about it are rare. The largest body of 
data which has been collected about it has probably been collected througji 
Likert's (1967) organizational survey questionnaires where a host of 
variables are assumed to be affected by- various management strategies and 
structures. Until recently, however, this work hte not used the concept 
of organizational climate at. all. It is one exaiiq?le of broad generaliza- 
tion occuring, thou^ e!H>irically the dimensions and the relationships 
amongst them turn out to be many and complex (Taylor and Bowers, 1972). 
If such generalization is useful then climate was not necessary as a 
concept to generate it, and in our opinion it is not so much the genera-- 
llzations from this work that are useful but the detailed empirical 
findings that have flowed from it. If the concept was useful in initiating 
attempts to conceptualize and measure the environment in which behavior 
occurs then it has been useful but its future utility now appears to be in 
question. Assuming researchers still do accept climate as a useful concept 
what sorts of research should it generate in the next few years? 

Some sugg estions for the Future if Climate is Retained as a Viable Concept 

1) To study what sort of things people in organizations do agree 
about. That is to try and get round the accuracy or consensus 
problem by finding out what agreement exists about and whether 
such information is informative and useful: perhaps people only 
agree about relatively trivial or conceptually unimportant things. 
This will also entail deciding what level of consensus is accept- 
able 100%, 90% or 60%? 

ii) Assuming consensus is easier to find within small groups in the 
organization it might be useful to develop techniques for des- 
cribing the pattern of climates that exist rather than relying 
on a mean score. The Institute of Social Research at Michigan 
already presents profiles for different levels in the organiza- 
tion, but these may not be the most natural groupings and more 
fruitful results might be achieved throu^ cluster analysis 
combined with some sort of description of the pattern of clusters. 
Techniques developed for the repertory grid may be applicable. 
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lii) Future studies of cllnate and job«'Satls faction should be 
careful to maintain the distinction between descriptive 
and evaluative measures. Perhaps all climate items should 
be followed by the question, "And how satisfied are you 
with that state of affairs?** other aspects of Job^atis*- 
faction could be measured separately* 

iv) The methodological pr<^lems involved in using aggregate 
scores from individuals to represent some larger social 
structure should be noted and steps taken to overcome them. 
Stern (1970) has already indicated one way in whidi this can 
be achieved. 

Some Suggestions for the Future if Climate is Re jected as a Viable Concept 

i) Assuming that researchers still feel it is necessary to try and 
describe the soclo-psydiological environments created in organi** 
zations then it may be worthwhile to try and explore the value 
of more ( ^jective methods of investigation such as those used by 
Barker in his studies of the **Stream of Behavior". In addition, 
to investigate the value of non-reactive measures of research 
and statistical data which may give clues as to the nature of 
the norms and values present in the organization* 

il) To reject large scale comparative studies of organizations due 
to the Inadequacy of the data they provide. As Argyris has so 
eloquently pointed out tl^re are some unintended consequences 
of rigorous research methods. Namely that subjects are put in 
a situation similar to that of a boss^-siibordlnate and this 
produces a relationship of distrust^ non**involvement , giving 
the researcher what he appears to want and getting him off yout 
back as quickly as possible. The remedy Argyris (1970) suggests 
is the organic research model outlined below: 

1. Researcher and subjects define research goals together. 

2. Subjects mre encouraged to question and get to know the 
researcher personally. 

3. Subjects choose how much they wish^to influence the 
researcher. 

4. Researcher^ encourages the subjects to define and control 
the research to make thorn feel as responsible for it as 
he Is. 

5. Subjects help to design the instruments^ methods and use 
of data (I.e. the change strategy). 

6. Data are fed back so as to help make the subjects more 
effective as people. 
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Tlie tine commltioent Involved In such a research process 
would pemdt only small coiq;>aratlve studies but If the or- 
ganizations -ere carefully selected to test out hypotheses, 
such as the effects of bureaucracy, centralization ^etc. 
they might give some good, valid data about the processes, 
norms, attitudes and values tliat are really operative In 
the organizations compared. One of the limitations of 
case-^studles and small-scale conq>aratlve studies is that It 
is difficult to see how they can be Integrated so that 
knowledge .uccumulates in a systematic way. The Navy appears 
to have a golden opportinlty to ensure that such studies do 
accumulate. This could be done by organizing gatherings of 
research workers who. could then agree what sorts of Issues 
need^ testing and return to their organizations to test them. 
Perhaps if we are to understand organizations we researchers 
need to get organized! 

ill) It might also prove vsj^uable to apply the methodology of the 
single case study currently being carried out in clinical 
psychology. This Involves developing measuring instruments 
for the particular case. Thus a questionnaire or Interview 
schedule is designed in the specific terms of the individual 
(or the individual organization) under study. The instruments 
are then administered over time to detect developments or stable 
patterns in the elements studied. Uelck (1972) has developed 
a technique for studying the processes at work in an orchestral 
rehearsal which could be used in this way. It involves Identi- 
fying the variables effecting orchestral performance, and then 
casting them into a matrix and asking the nsmbers of the band to 
say which variables are connected to which, in which direction 
and to what strength: a sort of j)henomenological causality. 
This gives a picture of the various processes at work and by 
analyzing the number of positive and negative signs helps to 
Identify whether the feedback processes are positive (and the 
rehearsal gets worse) or %irhether they are negative and thus 
self-correcting. This would appear to be a powerful method fur 
studying such things as control, decision-making or stress in 
organizations. The content of the matrix would be tailored to 
the individual organization of course but cooobined with the 
longitudinal application required by the individual case method 
could provide some very interesting Information about organiza- 
tional functioning. Such methods also have the advantage of 
being quantifiable and allowing the use of powerful statistical 
methods. Nor do they preclude comparative studies since tha 
content of the matrices produced in different organizations 
could be compared and where they are the sait'* satis tlcal tests 
could be used to examine differences. At the same time those 
things Ique to the particular organization are not lost and 
organizations can be compared in their uniqueness. It has 
always slightly bothered me that conventional scaling methods 
reject what is unique. 
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If the overall impression of this paper is one of negativism towards 
research on the concept of climate then it is perhaps worth reminding our- 
selves that science proceeds by attcrmpting to disprove its hypotheses. If 
we now reject the concept of climate let 'us not forget that this has in- 
creased our understanding if not our ability to predict and control. 
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SUBJECTIVE AND OBJECTIVE QPERATIONfLLIZftTIONS 
OF CLIMATE AND STRUCTURAL VABIABLES 



CLIMATE 



STRUCTURE 



SUBJECTIVE 



OBJECTIVE 



1. Risk and Support dimensions 
from Campbell et al 

2. Development and Progress 
siveness and Normative 
Control dimensions from 
Payne and Pheysey 



^^ Classification of Behavioiir 
Settings and Behaviour 
Episodes based on obser- 
vation from Barker 

2« Analysis of Critical 

Incidents as per F l a n agan 

3. Statistics on turnover, 
lateness Guid absenteeism 
etc* 1 



1. 'Structure and Autonomy dimen- 
sions from Campbell' et al 

Z. Job-codification, Central- 
ization and Hierarchy scales 
from Hage and A^en 



1* Structuring of Activities, 
Concentration of Authority, 
Line Control of Woiicflow 
from Pugh et al 

2« Various measures of Complex- 
ity and ConfiguraJ;ion from 
Blau and? Schoenherr 
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TABLE 2 



MEANS AND S.D.s ON 8 CLIMilTE SCALES 
IN 'SMOKESCREEM ' 





Mean 


S.D. 


Leaders Psych. Distance 




1.86 


Questioning Authority 


3.9^ 


1.98 


EtootionsJ. Control 




1.86 


Future Orientation 


5.27 


2.16 


Industri ousness 




2.19 


Interpersonal Aggression 


2.96 


2.28 


Rules Oi-ientation 




1.51 


Readiness to Innovate 




1.91 



N = 3*^ 



each sccde has 9 points, scored 0 - o. 
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TABLE 3 



CORRELATIONS BETWEEN 3 MEASURES OF OBGANIZftTION 
STRUCTURE AND ONE DIMENSION OF CLIMATE 
FOR 3 DIFraRENT SAHPI£S 



Organization 
Structure 
Variables 


Perceived Interpersonal Conflict 
Amongst Top Managers 


Birmingham 
U.K. 

N = 25 


Ohio 
N = 17 


Britain 
N = 78 


No. of fioiployees 




-12 


-05 


Structuring of Activities 




-18 


31 


Centralization 


-02 


^3 


-01 
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TABLE 4 

CORREUTIONS BETWEEN PERCEIVED STRUCTURE AND PERCEIVED 



CLIMATE VARIABLES FOR 3 STUDIES 



Structural Variables 



Climate Vsiriables 



v^t^ v^^tr,^ n --I.- I / Innovative Innovative Interpersonal! 

i<ole Form'zn Routine Definition' ' ^ ^. n . n x-t i. ' 

Expectations Behaviour Conflict 



2 


a« 


•2if 




b. 










■5 








b. 


76 




c« 


k9 


if 


a* 


35 




b. 






c« 


10 




a« 


09 




b. 


01 




c« 


33 


6 


a« 


-01 




b. 


11 




c« 


36 



26 
18 

3^ 



-66 

17 
.if8 



-37 



it? 
01 

03 



07 

-27 
.06 

-01 

06 

10 

09 

08 



50 

-02 
3^* 



-39 
-2it 
-02 



.1^ 
-12 

37 



(a) 25 Birmingham, U.K. Manufacturing organizations, top managers only 

(b) 17 Ohio manufacturing organizations, top managers only 

(c) 78 British manufacturing and service orgeuiizations, top managers only 
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TABLE -J 

CORREUTIONS BETWEEN INTELLECmL CLIMATE SCORE (CCI) 



AND OTHER MEASURES OF ACADEMIC QUALITY FROM 
STERN, 1970 





n 


r 


Knapp-^Greenbaum Index: 
"scholars" per 1000 


50 


.80- 


fercexiuage ox grauuetueo 

receiving Ph.D., 1956-1956 


37 


.76 


Percentage .if Merit Scholar 
entrants, 1956 


k^ 




Merit Scholars per 1000, I960 


25 


.59 


National Merit Scholarship 
Qualifying- Test means 


38 


.71 


CEEB-SAT Verbed. means 


i6 


.83 


CEEB-SAT Mathematical means 


i6 


.3^ j 
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TABLE 6 

CU.-1ATE. EFFECTIVENESS AND SATISFACTION 



Scale 


Effectiveness 


Satisfaction 


Org. 


Ind. 


Org. 


Ind. 


Structure 


-.70 


-.07 


.90 


-.32 


Level of rewEu:ds 


-.30 




.10 


.66 


Status polarization 


.90 


-.n't 


-.50 


-.39 


Flexibility-innovation 


1.00 


.08 


-.10 




Decision centralization 


-.70 


-.01* 


.60 


-.39 



N=5 N=71 



Frou Pr-Hchard & Karasick, 1973. 
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TABLE 7 



SUMMARY OF IMTERREIATIONSHIPS AMONG DESCRIPTIVE 
AND EVALUATIVE ITEMS IN JDI SCALE 'WORK ITSELF' ^' 



Evaluative items 


Descriptive items 


satisfying 

better than other jobs I've had 

worthwhi le 

boring 

wrong sort of job for me 

meem inter-item r = ,50 

mean item r vdth Hoppock = ,56 

mean inter-item r between de 


needs a lot of skill 

same day after day 

needs a lot of experience 

takes it out of you 

simple 

routine 

mean inter-item r = .12 

mean item r with Hoppock = .13 

scriptive and evaluative = .12 



These data and i:ie ideais behind them are attributable to my 
colleague Toby Wall. 
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■lABLE 8 



MAXIMUM. MINIMUM AND MEDIAN CORREIATIONS 
AMONGST SIX CLIMATE CLUSTERS . 
8 JDI CLUSTERS AND « SRA CLUSTERS 



r 





JDI 


SRA 




max 


min 


.nedian 


max 


rain 


piedisin 


SRA 


.67 


.08 


.25 








OC 


.66 


.05 


.25 


.61 


.10 


.33 



From Johaimesson, 1973* 



ERIC 



259 



270 



III-4.22 



References 



Argyris, C. (1970) Intervention Theory and Method , Addison-Wesley, 
Philippines . 

Bachman, J. G. , Smith C. G. , and Slesin^er; J. A. (1966) Control, 
Performance and Satisfaction: * an analysis of structvral and 
individual effects. Journal of Personality and Social Psychology , 
4, 127— 136 » 

Barker, R. G. (1963) "On The Nature of Tne Environment". Journal of 
Social Issues , XIX, 4, 17-38. 

Barker, R. G. and Gump, P. V. (1964) "Bi g School, .Imall School" . 
Stanford University Press, Stanford. 

Bennis, W. G. , Benne, K. and Chin, R. (1968) The PlanninR of Change . 
Holt, Rinehart and Winston, London. 

Blau, P. M. and Schoenherr R. A. (1971) "Th e Structure of Organizations" , 
Basic Books, New York. 

CaniJbell, J., Dunnette, M. D. , Lawler, E. E. and Weick, K. E. (1970) 

Managerial Behavior, Performance and Effectiveness . MfcGraw Hill, 
New York. \ 

Cartwright, D. (1973) Determinants of Scientific Progress: The Case of 
Research on the Risky Shift. American Psychologist , 28, 3, 222-231. 

Child, J. and Ellis, T. (1973) Predictors of Variation in Managerial Roles, 
Human Relations , 26, 2, 227-250. 

George, J. R. and Bishop, L. K. (1971) "Relationship of Organizational 

Structure and Teacher Personality Characteristics to Organizational 
Climate". Administrative Science Quarterly , 16, 4, 467-475. 

Gorman, L. and Malloy, E. (1972) "People, Jobs and Organizations" . Irish 
Management Institute, Dublin. 

Guilford, J. P. (1965) Fundamental Statistics in Psycho lo^ and Education . 
McGraw Hill, New York. 

Guion, R. M. (1973) "A Note on Organizational Climate". Organizational 
Behavior and Human Performance , 9, 1, 120-125. 

Hage, J* and Aiken, M. (1967) "Relationship Centralization to Other 

Structural Properties". Administrative Science Quarterly , 12, 72-92. 

Hoppock, R. (1935) Job-Satisfaction > Harper & Row, New York. 



271 

260 



III-4.23 



Inkson, J, K. , Schwitter, J. P., Pheysey, D. C. and Hickson, D. J. (1970a) 
"A Coiq)ari8on of Organization Structure and Managerial Roles, Ohio, 
U.S.A., and the Midlands, England". Journal o f Management Studies, 
7, 3A7-363. 

Johannesson, R. E. (1971) "Job Satisfaction and Perceptually Measured 

Organization Climate: Redundancy and Confusion", in key Developments 
in Management and Organization . cProceedings of 8th Annual Conference 
of Eastern Academy of ilanagament, Massachusetts. 

Johannesson, R. E. (1973) Some Problems in the Measurement of Organizational 
Climate, to appear in Organizational Behavior and Human Performance , 
August. 

Lawrence, P.R, and Lorsch, J. W. (1970) Developing Organizations; Dia^ 
nosis and Action . Addis on-Wes ley , Philippines. 

Likert, R. (1967) The Human Organization . McGraw Hill, New York. 

Payne, R. L. (1971) "Organizational Climate: The Concept and Some Research 
Findings". Prakseologia , NR 39/40/ROK. 

'J* 

Payne, R. L. and Pheysey, D. C. (1971) "C. G, Stems Organizational Climate 

Index: A Reconceptualization and Application to Business Organizations'* 
Organizational Behavior and Human Performance . 6, 1, 77-98. 

Payne, R. L. and Mansfield, R. M. (1972) "Relationships amonRst Organiza- 
tional Context, Structure, Hierairchical Level and Perceived Organiza- 
tional Climate" , unpublished working paper. University of Sheffield. 

Payne, R. L. and Pugh, D. S. (1973) "Organization Structure and Organization 
Climate" chapter to appear in Handbook of Industrial and Organizational 
Psychology . Ed. M. D. Dunnette, Rand McNally. 

Pritchard, R. D. and Karasick, B. W. (1973) The Effects of Organizational 
Climate on Managerial Job Performance and Job Satisfaction. 
Organizational Behavior and Human Performance . 9, 1, 126-146. 

Pugh, D. S., Hickson, D. J., Hinnings, C. R. and Turner, C. (1968) "Dimensions 
of Organization Structure". Administrative Science Quarterly , 13, 
65-105. 

Schneider, B. and Bartlett, C. J. (1970) "individual Differences and Organi- 
zational Climate II: Measurement of Organizational Climate by the 
Multi-trait, Multi-rater Matrix", Personnel Psychology . 23, 493-512. 

Stem, G. G. (1970) " People in Context: Measuring Person-Environment 
Congruence in Education and Industry ". John Wiley, New York. 



261 



111-4.24 



Tagiuri, and Litwin, G. H. (1968) OrRanlgatlonal Climate; Explorations 
of a Concept s Harvard University, Bostou* 



Taylor, J. C. and Bowers, D. (1972) The Survey of Organizations , 

Institute for Social Research, Ann Arbor, The University of Michigan. 

Weick, K. (1972) A Method for Studying Organizational Pi ^cesses . Paper 
presented at symposium on Organizational Processes, London Business 
School. 



/ 

I 



( 



III-4.25 



262 



ERIC 



\ 

ORGANIZATIONAL EFFECTIVENESS : DISCUSSANT ' 
James K« Arima 

' \ 

.Vs discussant of the splendid papers just presented, I propose to 
examine, first, the status of organizational effectiveness research in 
the Navy. Next, I shall try to explain why organizational effectiveness 
research occupies the status that it does. Then, I shall attempt to 
relate the approaches and ideas expressed by the speakers today with 
respect to their potential for improving the status that organizational 
effectiveness research presently occupies. Finally, I shalt add some 
commentr of ray own as to what directions organizational effectiveness 
research might take to be, itself, more effectived 

In order to appraise tb« status of organizational effectiveness 
research in the Navy today, I shall make use of some data collected 
in a survey to evaluate project selection for personnel and manpower R&D 
in the Navy. The respondents, numbering 200, included senior Navy 
Officers in the Bureau of Naval Personnel and OPNav, the entire pro- 
fessional staff of tfie Personnel Research Division, almost everybody from 
top management down to and including project leaders in the, then, 
Washington and San Diego Navy personnel R&D laboratories, a group of 
middle managers in the Navy— mostly lieutenants .and lieutenant commanders, 
the heads and directors of. civilian contractor organizations doing work 
for the Navy in personnel R&D, and members .of the AdvigDry Panel for Per- 
sonnel Research. Laboratories of the Naval Research! Advisory Committee. 
These people were asked to rank 18 R&D program -elements (Fig. 1) according 
to two criteria. . 'One was military significance, defined as the importance 
of payoff to the Navy of successful research In the afea of the program 
Element, The oth.e? was investment risk, defined as the probability of a 
successful research effort independent of its payoff. One of the elements 
to be ranked was organizational effectiveness research, defined as follows: 

Development and evaluation of ^techniques for measuring overall 
military effectiveness of organizational units^ under various contin- 
gencies. This involves the development of empirically based criteria 
and the relative in^or*-ance of criteria which should be applied in 
making judgments of organizational effectiveness. It includes studies 
of individual and organizational behavior and evaluative research 
into managerial practices and organizational characteristics. The 
principal objective is the enhancement of organizational effectiveness 
in relation to» organizational goals and total system effectiveness, 
o « 
Usted as a typical projecf under the prdgram eiement was one called 
''Development of concepts and criteria for organizational effectiveness." 

The first graph (Fig,;2) shows the scaled results of the rankings for 
the entire group of respondents for the military significance crit^ion. 
As it has been brought out in this conference, 'the Navy community seems to 
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be most willing to see what it can do about manipulating individuals to 
improve the status of the Navy as a whole. Educating, retaining, re- 
cruiting, and getting them co perform better will result in the greatest 
payoff, according to thi« elide. Organfzational effectiveness research 
gets very short shrift here. The i'dea seems to be that, if we take care 
of the individual personnel problems, organizational effectiveness will 
take care of itself. It r also mean that the respondents have their own 
ideas of organizational ef tectlveness research and do not believe the 
definition given-to enhance total system effectiveness. If they believed 
It, it would have to be ranked first. My hunch is that they equate "or- 
ganizational effectiveness" with the exhortations and practices of the 
practitioner— the OD change agent—rather than the researcher's definition 
of organizational ef lectiveness . 

The next graph (Fig. 3) is for the senior Navy officers-the sponsors 
and monitors of the R&D efforts listed. The pattern seen here is distinctly 
much more of the same. They seem to be saying, "Set up your requirements, 
recruit and retain your personnel, distribute and assign them optimally," and 
the other things an- of relatively" minor importance. 

The next graph (Fig. 4) is for the middle managers in the Navy—the 
users of research p.roducts. Again, we have more of' the same. "Retain 
them, train them, get their performance up," is the message I see here. 

This graph (Fig. 5) is for the advisory panel, which represents the 
academic viewpoint. At this stage, everyone is. apparently convinced that 
you must hold on to people or there will not beVNavy to worry about. But 
the prograiiB next in order of precedence are quiteNiitferent from the pre- 
vious slides. They show a strong emphasis on the paWf to be obtained from 
organizational effectiveness research and research to iihprove the attitudes 
and motivation of Navy personnel. Their emphasis on eduction and training 
research, along with the emphasis on organizational effectiveness and atti- 
tudes and motivation, implies a broader conceptualization of Navy education 
and training than the emphasis given it by the middle managers (F^g. 4) for 
example. The latter pair it with research to ehhance individual performance, 
suggesting that their emphasis was on the traditional areas of skill training. 

Projecting these results into the future, the 'SO's, the advisory panel 
results can be interpreted as saying that the world and the Navy are changing- 
that problems in traditional research areas, such as selection, training clas- 
sification, and occupational areas, cannot be divorced from the aspirations 
^nd life style of the individuals and socie'cy in general; and that only re-' ' 
search in the larger context of the total organizational setting will solve 
the intricate personnel-related problems that are presenting themselves to the 
Navy. 

Now, we shall turn to the investment risk criterion • Here, you will 
find that the higher the scaJed value, th^ greater is the probability of a 
successful research effort cad thd better it is as an investment risk. 
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As5 previously, the first graph (Fig. 6) presents the results for 
the tutire group of respondents. The picture has changed considerably 
from the graph for the military significance criterion, but organiza- 
tional effectiveness research is even lower in priority than previously. 
It is grouped with research in the areas of drugs, attitude and motiva- 
tion, and minorities as the poorest risk from a research standpoint. 

Here is the graph (Fig. 7) for the senior Navy personnel. Note 
where organizational effectiveness is. j, 

The next graph (Fig. 8) is ^or the middle managers of the Navy. 
They still see the greatest probability of successful research efforts 
in the traditional areas which we have referred to as individual personnel 
manipulation. Organizational effectiveness research Lakes a definite back 
seat. 



Now imagine what the graph for the advisory panel will look like on 
this criterion. Here, then, is the graph (Fig. 9) for the academic side 
ot the house. They also see that research in the areas of attitudes and 
motivation and organizational effectiveness are very difficult relative to 
research in other areas. Incidentally, the criterion included a 10-year 
period for a successful effort to take place, so in keeping with the theme 

the conference, this chart does take us well into the 'SO's. Consi- 
dering this chart along with the military significance rankings for this 
panel of judges (Fig. 5), I would not anticipate much argument if I were 
to say that, .according to the advisory panel, the areas of research where 
the greatest payoffs to the Navy seem to lie are also areas where the 
probability of successful research efforts are most difficult to attain. 
Where the two are more-or-less consistent, as in the other pairings of 
figures on the two criteria, there is no great decision problem because 
unsuccessful research efforts are seen as most likely to occur where the 
apparent payoffs to the 'avy are the least. This implies that research 
techniques have been developed t< meet those needs that are large and leads 
to the position that current research should be programmed to cash in on 
such developments. Eventually, this position says "do more of the same, 
but do it even better." Unfortunately, this path may l?ad to stereotyped 
behavior and insensitivity to subtle changes in the needs of the organiza- 
tion— i.e., the Navy. It may even lead to the situation where endearment 
with capabilities and techniques leads to exquisite solutions without find- 
ing out what the problem really is. If this trend is in the making, the 
advisory panel may be giving a message that says, "We ^re hurting and need 
a lot of effort and in^rovement in the areas of attitude and motivation 
research and research in the broad area of organizational effectiveness." 

How can this message be put across to the Navy R&D community and the 
sponsor/user of personnel and manpower R&D? It may turn out tp be a 
difficult process, but we must convince the sponsor, especially, that doing 
something about the organization may come first and that solutions in the 
other problem areas will not come about without solutions in the arena of 
greater problems. That is, the problems that they, the sponsor /users , see 
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in the areas of recruitment, personnel performance, and retention may 
only be solved by very serious effort directed toward improving the 
various aspects of orgaikzational functioning, the organizational climate, 
and the organizational iitiage. 

Turning now to the papers that were given today, I would like to 
single out the emphasis given to defining just what is organizational 
effectiveness. 1 feel that this is one of the most important areas for 
two reasons. First, the definition of organizational effectiveness given 
by a researcher tends to determine the phenomena that he will examine and 
the direction of his ef forts when all researchers are taken as a group, 
their definitions define the field of organizational effectiveness research. 
Secondly, the definition of organizational effectiveness, with emphasis on 
effectiveness measures, is the most direct and convincing approach to the 
decision-maker, line person, or sponsor of research. It is our means, as 
researchers, of communicating to him what organizational effectiveness 
res^ai^ is about and what it can do for him. 

Accordingly, when we are doing research for a military sponsor, we 
must,, as both Jonn Campbell and George Mllkovich pointed out, find out 
what he is thinking in terms of effectiveness. Then, it must be shown how 
our research contributes to his Ideasr of "total system effectiveness 
This, in turn, requires us to look cit our research in a hierarchical frame- 
work of inputs aiid output measures, as described by John Campbell. The 
picture that appears is not unlike the concept of linkage pins in a manage- 
ment structure that Jerry Franklin presented in his paper. That is, goals 
or objectives at one level of research become inputs at another level — ends 
become means and means become ^nds. This chain must have much face validity^ 
for the decision-maker and sponsor of organizational effectiveness research .| 

At this time, I would like to call your attention to one focal point 
where hard thinking takes place about military effectiveness measures. I 
have had the privilege of being on the board of directors of the Military 
Operations Research Society for the last four years. We hold two symposia 
a year and as far back as I can remember, we have had a very viable working 
group on measures of effectiveness at each of the symposia. Some of their 
deliberations are recorded in the proceedings of the symposia, but the only 
way to get the details and flayor of the discussions is to take active part 
in the working group sessions. 

The papers in this session also touched on the question of "What 
should measures of effectiveness look like in organizational effectiveness 
research?" The complexity of this question has been clearly presented by 
John Campbell, and one of his conclusions is that you jvst can't add up 
the output and call it effectiveness. He has also brought out the need for 
a uni^-ef fectlveness, "overall value" measure, if we are to do research in 
which the unit, and not the individual, is the focus of research — the degree 
of freedom. 

George Mllkovich 's pr^^sentation has brought out t^ considerations 
that one must weigh in coming up with a measure of unit effectiveness, such 
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as the Naval Personnel Status Index (PSI). George debated the value of 
a single nunJber index versus a profile measure. My feelings are that, 
from the standpoint of a strictly effectiveness measure, one single number 
would be highly desirable because there are many powerful techniques for 
making that number an objective function and applying specific effective- 
ness criteria to it, such as maximization, minimization, mlnlmax, etc. On 
the other hand, a profile measure is advantageous from the viewpoint of 
the researcher for its heuristic and diagnostic value. Unfortunately, a 
good measure (quantification) of a profile has yet to be developed. 

Another feature of the presentations that, is worthy of comment is 
what they had to say, explicitly or implicitly, about, methodology. I feel 
that John Campbell set the scene for us in this area b/ emphasizing, first, 
the distinction between the attitudes of the OD practitioner and the re- 
searcher in organizational effectiveness. Then John emphasized the pro- 
found difference in approaches to the study of organizations that exist 
between the goal-centered viewpoint and the natural systems viewpoint. 

With respect to the first dimension, let us call it the practical- 
abstract dimension, the presentations varied considerably. Jerry Franklin's 
presentation was close to the practitioner's world in that the four-factor 
model that was being developed was to be applied to the Intervention process — 
the change-agent role of the OD practitioner. George Mllkovlch's presenta- 
tion was also close to the developmental end of the research spectrum in 
attempting to determine an objective function that was meaningful to real Navy 
organizations. Roy Payne's presentation emphasized the gathering of empirical 
data to show that it is difficult, but possible, to use the unit or organiza- 
tion as the degree of freedom, and to impress on us again the efficient and 
pragmatic approach that so often characterizes research in Great Britain. 
Finally, and returning to John Campbell, he seemed to be advocating a careful 
study of independent, process, and dependent variables and their relationships. 
Such a method would be more abstract than the others and yet more generali- 
4.able. 

All presentations spoke of the necessity of models, b^ut only Jerry 
Franklin mentioned models in the sense of conqputer simulations of organiza- 
tional processes and whole organizations. I feel that this route could do 
much for organizational effectiveness research in that it would take some of 
the attention away from measurement and focus efforts on data availability, 
as mentioned by both George and Jerry. Jerry mentioned that persons who take 
the computer modeling approach are not very much concerned with measurement, 
and I might add that this may be so because, if they don't like what they 
see, they can change it easily as the data become available. The simulation 
route would also make it possible to accomodate John Campbell's ideas In that 
organizations could be the degrees of freedom with concern only for computer 
clme and that the parametric relationships among variables could be investi- 
gated rigorously using sensitivity analysis techniques. Validation of the 
computer model would provide a comprehensive framework for empirical research 
and data rollection. 
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None of the papers, it seemed to me, took up the natural systems 
approach to the study of organizations. It may be because the ideas are 
newer, more abstract, and more difficult to apyly in a paiticular setting, 
such as a specific type of Navy organization, th*.n the goal--c entered 
approach. Tha latter is apparently more sii)i5)le and straightforward ±v 
that the organization is seen as a set of rational decision^makers • li 
articulates well with the theory of formal organizations, which is specially 
appropriate in the instance of military org|inization8. But the natural 
systems approach, which is often called the open systems model, may have 
great value in the investigation of Navy organizations in the *80*s. 
Stating it overly succinctly, the theory states that the function of an 
organization is to survive, and its effectiveness is its viability (Ashby, 
1968; Katz & Kahn, 1966; Seller, 1967). This conceptualization of an 
organi-:ation would seem to be true of the Navy, whether the battle is with 
Capitol Hill in peacetime or a sophisticated enemy in high-intensity warfare. 
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Short Title 



Full Title 



Drugs 

Educ,/Tmg. 
Occupat • R&D 
Costs 

Requirements 

Management 

Man-Machine 

Select • /Class • 

Applied Sys. 

Careers 

Retention 

Attlt./Motiv. 

Minorities 

Org, Effect. 
Dlst. /Asgmt. 
R&D Mngmt. 
Recruitment 
Performance 



urug Abuse 

Education and Training 

Occupational Research and Development 

Manpower /Personnel Cost Systems 

Manpower Requirements 

Personnel Management Systems 

Man*Machlne Systems R&D 

Selection/Classification 

Applied Systems Development 

Career Structures 

Personnel Retention 

At tit ude /Mo t Ivat Ion 

Minority Discrimination Measurement and 
Reduction 

Organizational Effectiveness 
Dis t r lb ut ion /As si gnment 
R&D Resources Management 
Recruitment /Procurement 
Personnel Performance 



Fig. 1 . Navy personnel R&D program elements ranked by judges. 
The short titles will be used in subsequent figures. 



2«0 



III-5.7 



ERIC 



269 




at 
ti 

s 



o 
o 
o 

o 

8 



o 
o 

c 



tiJ * 

111 3^ 

o < 

a 2 



o 



O 



o 
< 

I 

< 

o 



-i 
o 

H 
U 

lU 
(O 
<D 
O 



CO 



o 



w £ 
CL a* 

<i» 
o 



u 
m 



III 

O QC 

o — 



2 H ^ 

O S 2 2 

u: ©> o H 

it tu >5 31 3 

le H S ei ^ ^ 5 

H 5 a; ^ 0 bl 

S 3i o o oe or ol 

I*) ^ n 10 N a> 



ca 



or 

s 

a: 
u 



o: 



CSI 

o> 



u 



111-5.8 



2«1 



ERIC 



270 



o 



to 



O 

cvl 




n 



01 

u 

c 

Its 

o 



c 



(/I 



I- 

X 

o 
9 



B 
01 



o 
(/I 
c 

0) 

B 

E 
o 



O ^ 



o ^- 
c 
cx 



in 



o 

S Q 



o 
< 

O 

o 
o 

o o 



CD 



lU 

ui 

P 1 

CO o 
O UJ 

o oe: 
o 



H 

SB 

UJ 

< 

s 

o 



UI 
Z 

X 

o 
< 
a 

t 

2 
< 

a 

N 
O 



C4 
CO 



H 
O 

y 

00 

o 



CO 

> 

CO 

o 

hi 

a 
< 
O 



CO 

cr 

bi 
Ui 

5 



III ' 

ju U. O 

at ^ 5 III ^ 

UI H o • ^ 



5* 

as r « 
9 o " 



o - 



CM 



2 

i 

10 



o 



o 



K UI 

2 y 

K S 

3^ 2 2 

2 3 o 

O * ^ 

o o ct 

« S w 

(t o: ol 

CO N « 



to 
0) 

:5 



u 
c 

o 

E 



<II 
> 



4J 

*0 



a: 



o 
to 
c 
o 

Ol 

%/% 
0) 

x: 



o 



c 
o 

0) 

u 



2«? 



III-5.9 



ERIC 



271 




2«? 



III-5.10 



ERIC 



272 




u 



O III 

o o 



H 
Z 

Ul 

< 
< 

o 



z 

X 

o 
< 

I 

z 
< 
s 



< 



H 
O 



09 
O 



tn 
tn 



OL 
< 

o 



if) 

a: 

UJ 
UJ 

a: 

5 



2f 

O 



0) 
UJ 



E O 



Ul 



UJ 



o 

CO 



Z 

Ul 



^ tt ^ 



= a: Z! 
X o o 



UJ 

o 
z 

i i ^ 

o « s 

O U OC 
0 61 S 

a: c CL 

10 N CD 







01 








u 








c 








to 








u 








•f— 








^- 
















c 












o 












to 












>» 








mm 








(O 
















•r— 
















•r- 




*? 




E 
































C 








o 












o 












en 








E 








Q> 
















a> 






TS 


ram 




X 


cn 




— • 


o 


ro 


ne 




Ui 


CL 


pa 














o 


t 
















o 






ts 


is 


«• 






> 






cn 
















01 










O 






















0> 








u 








c 


0> 




























O 








Ou 


o 














'1-* 










c 






0> 


o 






> 


•r- 






•I-* 










<u 






to 








r— 








0> 










u 






in 








• 








cn 








•r- 








U. 





2Rf 



III-5.11 



273 




m 

CM 



CO 



c 

o 
> 
c 



01 



IC 

o 

«/> 

c: 

B 
01 

'oi 

E 



lO 



o 

UJ ^ 



x: 

01 
O 



CO 

o 



o 



S 6 



M 

O 



m 
< 

O 
O 

o 
tn 
o 



CO 



Ul 

ai 

UJ 

e i 

CO o 

o u 
o a: 

^ « 

o o 



Ul 

< 
Z 
< 

<£> 
O 



Ul 

z 

X 

o 



N 
O 



CO 

< 

o 

y 

Ul 

vy 
«> 
o 



€0 
>• 
CO 

a 

Ul 
CL 
< 

o 



(O 

cr 

Ui 
UJ 

q: 
< 



z 

o 

H 
Z 
Ul 
H 
Ul 



o - 



o 

€4 



CO 
Ul 



q: 
o 
z 

i 



o 

Ul 

Ik 
Ik 

Ul 

6 
(t 
o 



<^ 5 

CO o 

K o 

CO ^ 

o or 

» CP 



Ul 



^ o 
q: u. 

Ul Ul 



0) 

> 



01 

c 

O. 



Si- 

o 



c 
o 



01 



o 



/ 



ERIC 



274 



III-5.12 




275 




III-5.15 



ERIC 



277 



References 

Ashby, W. R. Principles of the self-organizing system. In W. Buckley 

(Ed,), Modem systems research for the behavioral scientist . Chicago: 
Aldlne, 1968. 

Katz, D. & Kahn, R. L. The social psycholo^ of organizations . New York: 
Wiley, 1966. 

Seller, J* A. Systems analysis in organizational behavxor. Homewood, 
Illinois: Irwln-Dorsey, 1967. 



Footnote 

I. Invitations to attend the MORS symposia can be obtained from: Military 
Operations Research Society, 101 South Whiting Street, Alexandria, VA. 

22304. 
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AN OVERVIEW OF MOTIVATION TO WORK 
Robert Penn 

» 

Introd uctio n 

Any conference that focuses on organizational behavior inevitably 
deals with the topic of motivation in one form or another. In this 
section, the speakers will address .4:hemselves to some of the problems 
encountered in Conducting research on the motivation to work, 

I will begin by presenting a brief overview of some of the current 
theories of motivation that are pertinent to organizational behavior. 

Or. Graham will evaluate the "st?te of the art" by discussing the 
validity of current theories, whether they work, and If not, why not? 
He will also discuss the difficulties of conducting research on motiva- 
tion to work and will present some research Ideas that he thinks organi- 
zations should be doing. 

Dr. Zedeck's paper will focus on normative vs, Ipsatlve models of 
measurement, and present some new approaches regarding :he use of 
regression analysis as they apply to .motivational research. 

The choice of the topic, "Motivation to Work," stems 'from an 
interest in the subject. An ev^r increasing effort on the part of 
psychologists has been directed; at establishing the relevance of 
motivational theories to work behavior. 

It is the opinion of some that a considerable portion of this activ- 
ity has been spurred by management's apparent concern with improving the 
quality and quantity of work through cBanges in worker motivation. 
Changes in management's attitudes to workers that have occurred in the 
last 20-25 years can be attrlbi|ted to the efforts of psychologists. 

Def inition of Terms 

1 have always been impressed with the confusion that exists ^regard- 
ing the meaning of the concept of motivation. The definition I feel most 
confortable with is one provided by ^farshall Jones at the 1955 Nebraska 
Symposium on Motivation: "... how behavior gets started, is energized, 
is sustained, is directed, is stopped, and what kind of subjective reac- 
tion is present in the organism while all this is going on." This, being 
one of the broadest definitions I have read, thereby enables us to 
incorporate for our discussion almost any theory. Others, such as Bandra, 
focus on the goal-directed aspects of behavior, and still others have 
concentrated their efforts to the energizing and directing aspects of an 
individuaTs actions. Regardless of the definition one accepts, we still 
must concern ourselves with the variables that affect the behaviors we 
are interested in investigating. 
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Another concept that needs defining is that of work. An acceptable 
definition of work is that developed by Vroom (1964) where' he substitutes 
"work role" for the term "work". "A work role is defined as a set of 
functions to be performed by a role oocupant, the performance of which 
contributed to the production of goods and services." To which I would 
add, "and for which compensation is derived". 

Job Satisfaction and Work Motivation 

While it is not the purpose of this session of the conference to dwell 
on the relationship between job satisfaction and motivation to work, the 
two topics appear inextricable. Prior to Brayfield & Crockett's (1955) 
review of attitudes and performance, it was generally regarded that 
satisfied workers were more highly motivated than non-satisfied workers, 
and therefore it followed that satisfied workers would be more produc- 
tive. Thrt Brayfield and Crockett review was revealing in that no clear- 
cut statement could be made regarding one's attitude toward, his work and 
consequent performance. This conclusion leads to an ever greater effort 
on the part of researchers to bring clarity to this area of concern. 

Recently it was reported (Lawler, 1970) that there have been at least 
5000 studies. ;in the literature that were concerned with job attitudes and 
that most of these were focused on job satisfaction. The purpose here is 
not to disduss the controversies that have arisen regarding the measure* 
meat of jpb satisfaction and the fact that the relationship between job 
satisfaction and motivation is far from being clearly understood, but 
rather to point out that until this problem is clarified, the contribution 
of studies of job satisfaction to understanding work motivation will be 
negligible. 

Motivational Theories 

In attempting to assess the relationship between motivation and work, 
one immediately becomes impressed with the lack of unanimity among psycho-- 
legists in presenting their respective position^. The following questions 
Mere posed by Gardner Lindzey (1958) that he felt required resolution before 
any real progress could be made in resolving differences among theorists. 
They appear as germane today as when they were written. 

a. How important are conscious as opposed to unconscious motives 
in understanding human behavior? • 

b. What is the relative importance of direct as opposed to indirect 
techniques for assessing human motives? 

c. Is it essential, in assessing motives, to provide some appraisal 
of the ego processes, directive mechanisms, or cognitive controls 
that intervene between the motive and its expression? 
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In assess! ig human, motives , how important is it to spccity the 
situational context within which the motives operate? 

How necessary is knowledge of the past in the assessment of 
contemporary motivation? 

At this time is the area of motivation more in need of developing 
precise and highly objective measures of known motives or identi- 
fying significant new motivational variables? 

In attempting to understand human motivation is it advisable at 
present to focus upon one or a small number of motivational 
variables, or should an effort be made to appraise a wide array 
of variables? Do multivariate techniques of analysis hive an 
indispensable contribution to offer to the study of human 
motivation? 

What is the relative Importance of detailed studies of individual 
cases, compared to carefully controlled experimental research 
and large-scale investigations? 

Is there a unique and iDq)ortant cotttribution to the understanding 
of human motives that can be made at present through the medium 
of comparative or lower-animal studies which cannot be duplicated 
by means of investigations utilizing human subjects? 

In light of all the difficulties one has in answering or dealing with 
the foregoing questions, perhaps one should follow the dictate of George Kelly* 
(1958) notion that the concept of motivation be repudiated. Even if one were 
to agree with Professor Kelly, who in the same article dealt with these nine 
questions by refuting their relevance or appropriateness to the study of 
human behavior, the concept of motivation appears permanently Implanted in 
psychological repertory and theories of motivation continue to come forth. 

One of the best reviews of motivational theories can be found in 
Campbell, Dunnette, Lawler and Welch's book. Man agerial Behavior > Performance . 
and Effectiveness (1970). A unique part of this review is the classif icatory 
scheme derived by the authors in dividing theories into two groups: 

a. mechanical or process theories; 

b-.^ - substantive or content theories. 

Mechanical or process theories attempt to describe the how of motivation, 
i.e. how behavior is energized, directed, etc. According to Campbell et al>. 
process theories attempt to define the Important variables And how they inter- 
act. 

Content theories, on the other hand, are more concernea with what there 
is about a person or his environment that motivates behavior. In this sense 
they are, in some respects, related to what many of us have referred to as 
personality theories, although content theories also attempt to identify the 
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variables that motivate behavior. The authors of this classification scheme 
acknowledge that the two groups are not always mutually exclusive. 

Process Theories 

The best knovm of the process theories are the S-R-reinforcement, 
theories, best exemplified by the work of Clark Hull (1943) and his followers 
and the advocates of cognitive theories of behavior reflected in the early 
work of Tolman (1932) and Lewin (1938). Both of these theoretical positions 
have their basis in a form of hedonistic thought. The principle of reinforce- 
ment, which is the cornerstone of most S-R theories, has contributed much 
to psychologists' ability to predict and alter many behavioral outcomes. At 
the same nime, the cognitive psychologists did not place as great an emphasis 
on the principle of reinforcement. Most cognitive theorists placed greater 
emphasis on the goal*directed aspects of Lehavior and where one*s choices " 
were not as dependent or^ historical antecedents of the individual. There 
are, of course, other differences between the two approaches ^ which are not 
dealt with here. The theories that have been most fruitful in generating 
research in Organir.ati^nal Psychology are primarily those propounded by the 
cognitive theorists. Cognitive theorists who have dealt specifically with 
the work environment are: 

Instrumentality Expectation Theory: Vroom (1964), Porter & Lawler (1968) 

Galbraith & Cummings (1967, Graen (1969) 

Balance Theory; Korman (1970) 

Equity Theory: Adams (1963) 

The basis for the work of these approaches can be found in the reports of 
Peak (1955), Rotter (1955), Geoupoulis et al. (1957), Atkinson (1958), Toij^man 
(1959), and Romans (1961), Briefly, the major propositions stated by the/se 
theorists are as follows: j 

Vroom I 

I 

a« The valence of an outcome to a person is a monotonically / 
increasing function of the algebraic sum of the products / 
of the valences of all other outcomes and his conceptions / 
of its instrumentality for the attainment of these other / 
outcomes. / 

b. The force on a person to perform an act is a monotonically 
increasing function of the algebraic sum of the products/ of 
the valences of all outcomes and the strength of his exfiec- 
tancies that the act will be followed by the attainment of 
these outcomes. 

Valence, then, refers to pteference toward specific outcomes, positive 
or negative. Expectancy refers to the likelihood that an act will be followed 
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by an outcome. Saying It another way, the valence (preference) for 
attai/ilng a first level outcome depends on his subjective estimate of 
the consequences of this outcome (secon<^ level outcone) and how attractive 
or unattractl\ a these second level outcomes are, 

VroL^ sees the application for this cheory In the area of occupational 
choice, job performance, and job attrition and job satisfaction. Essen- 
tially, then, Vroom postulates two models. Mitchell and Blglan (1971), 
In their Psychology Bulletin review of Instrumentality theories, referred 
to the valence portion as a job satisfaction model, essentially because the 
model says that an Individual's satisfaction with his, job results from the 
Instrumentality of the job for attaining other outcomes and the valence 
of those outcomes. Mitchell and Blglan refer to Vroom 's second model as 
the job performance model since the Individual's expectancy Is defined by 
Vroom as his belief concerning the probability that the behavior In question 
will be followed by the outcome of Interest, with the expectancy Interpreted 
as a perceived probability ranging from 0 to +1. It Is distinguished from 
instrumentality in that it is an action — outcome association while instru- 
mentality is an outcome — outcome association. 

Vroom' s model has been tested by Galbraith and Cummings (1967), 
Porter and Lawler (1968), Hackman and Porter (1968), and Graen (1969). 
?orter and Lawler differ from Vroom by the introduction of moderator 
variables in the form of ability and role perception in describing the re^. 
lationship between effort and pezformanco. Over all, their work has resulted 
in moderate success. 

Graen (1969) extended Vroom' s theoretical approach by differentiating 
between first and second level outcomes, as the first level outcome is 
called a work role, while second level outcomes are called role outcomes 
that occur because of successful completion of work roles. 

The most thorough test of an instrumentality theory has been reported 
by Jorgenson et al, (1973). In general, the results, while interesting and 
somewhat corroborating of the general theory, have been disappointing. 
Correlations (usually multiple) were significant but low. Possible reasons 
for this are; 

^* a priori outcomes may not be complete or relevant; " 

b. interaction effects o& outcomes not measured: 

c. extent to which individual has control over his own behavior; 

d. performance (first level output) measures may not be dependent* 
on individual's effort. 

There are some specific criticisms of expectancy theory that will be 
dealt with later by Dr. Graham. 
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Equity Theory / . 

Equity theory has been formulated most thoroughly by J. S. Adams 
(1963, 1965> and most authors tend to associate it with his name. For 
those incferested in a more complete understanding, refer to Pritchard*s 
(1969) review in Organizational Behavior and Human Performance . 
Essentially the theory deals with: ~ ~" 

a. a worker's inputs and outcomes; 

b. a process of social compensation; 

c. conditions leading to equity or inequity and their effects; 

d. reactions to conditions of inequity. 

^'^P^ts involve everything a person perceives as significant for getting 
something in return for his investment. 

Outcomes involve what a person gets for his investment that is signifi- 
cant to him. 

Paraphrasing Pr it chard, "Equity is said to occur when an individual 
(person) interprets the ratio of his Outcomes to Inputs as equal to someone 
else's (a relevant other) O-I ratio," Inequity results when: 

a. perison and other are on a one-to-one baais (direct Exchange); 

b. whenJuith.^^ involved with a third party (employer). 

When inequity exists, according to Adams, (depending on whether he is 
underrewarded or overrewarded) a person will try to bring about a condition 
of equity by: 

, a, changing his inptits or outcomes; 

b. changing the comparison other; 

c. getting the other to change; 

d. distorting what he perceives. 

While there are many problems raised by this theory that require resolution, 
nevertheless, the hypotheses are testable, and though the literature yields 
equivocal results, it appears as a way of dealing with one's perception of 
his pay and its effects on performance. 

A comparison of predictions made by equity theory with those of expec- 
tancy theory has been dealt ^ith by Lawler (19/i), He points out that equity 
theory would predict that when one changes the amount of pay that a person 
receives, that this change in pay will affect motivation. Expectancy theory 
makes no prediction unless the amount of pay is seen as dependent upon job 
performance. One other major difference is that expectancy theory predicts 
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that increase in the reward size should lead to increased motivation to act 
in whatever way leads to the reward. Equity theory would predict just the 
opposite, especially in the piece-rate situation where pay depends on 
productivity. Finally, equity theory is unique as a process theory in that 
the central theme is that the only motivations of an individual that are 
considered are those itivolved in a comparison process with someone else. 

One other process theoi'y that has been developed for work behavior is 
the "balance" or "consistency" theory put forth by Abraham Korraan (1970) 
which emphasized self-evaluation and self-perception as well as conceptions 
deriving from past reinforcements. In this sense it is historical as well 
as ahistorical. The basic hypothesis is as follows: "All other things 
being equal, individuals will engage in, and find satisfying, those behavioral 
roles which will maximize their sense or cognitive. balance or consistency." 
Korman then presents the derivations that would be implied from the above 
hypothesis; 

a. Iiidividuals will be motivated to perform on a task or job in 
a manner which is consistent with the self-image with which 
they approach the task or job situation. That is, to the extent 
that their self-concept concerning the job or task situation 
requires effective performance in olrder to result In "consistent" 
cognitions, then, to that extent, they will be motivated to 
engage in effective performance. 

b. Individuals will tend to choose and find most satisfying those 

job and task roles which are consist^ent with their ^elf-cognitions. 
Thus, to the extent that an individual has a self-cognition of 
himself as a competent, need-satisfying individual, then, to that 
extent » he will choose and find most satisfying those situations 
which are in balance with these self-perceptions. 

Korman goes on to cite the kinds of research evidence that are supportive 
of this hypothesis, developed by his own work and that of others. For example, 
Aronson and Carlsmith (1962) who found that when a person's performance is 
too high for his self-conception of his ability, he will try to decrease his 
performance in order to match his self-conception. He interprets the Adams 
and Rosenbaum (1965) study of equity theory, that individuals who have too 
high reward made contingent on their behavior will adjust their behavior in 
order that ou*- comes will be at a lower, more appropriate level* It thus 
seems that the predictions of equijty theory c£,n be incorporated under this 
notion of balance end consistency. Korman provides some experimental evi- 
dence of his own which is somewhat supporting of the basic notion. A key 
element to the theory obviously rests on the manner in which one's self- 
conception, or putting it another way, how one's self-esteem is measured or 
manipulated, particularly when one is dealing with work behavior. 

As mentioned earlier, SR reinforcement theories have generally not been 
as well accepted among industrial psychologists nor management personnel 
generally. This is surprising when one considers that the impact of rein- 
forcement principles, particularly as espoused by Skinner and other operant 
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psycho logisns, are at the forefront in fields of academia» therapy, child 
rearing practices? . and classroom learning. While there are no definite 
answers as to the failure of operant psychologists to have a greater impact 
on the world of organizational behavior^ it would appear that one of the 
reasons would be the development of humanistic psychology in industry that 
occurred as a reaction to the proponents of what has come to be known as 
"Taylorism" which followed more closely in lines of traditional thinking 
of rewards and punishment. Within this framework of thinking, one can deal ' 
more adequately with affective aspects of behavior that ave not specially' 
pertinent to reinforcement psychology. Thirdly, industry has always been 
somewhat behind the Zeitgeist that has occurred in academic circles, and 
perhaps the decade of the 80 's will find the use of operant techniques more 
in the forefront. Lastly, cognitive psychologists have faced up to the 
problems of alienation and boredom that ^PP^^^ to confront many workers, 
whereas reinforcement theorists, for the most part, have not addressed 
themselves to these issues. It is this Ic^tter point that ir most signifi* 
cant. If the theories of reinforcement are to have any bearing or impact 
on problems of organizational behavior, then they must address themselves 
to these issues. > 

Content Theories * o 

Of the various content theories that have been developed, only a few 
have had relevance for organizational behavior. The names of Maslow (1^54) 
and McGregor (1960) rank at the top of those whose theoretical formulations 
have been most widely acctepted by industrial leaders. Maslow's basic theory 
postulates a set of psychological needs that develop in a hierarchy from 
lowest to highest as follows: 



a. 


physiological needs; 


b. 


safety needs; 


c. 


social needs; 


d 


esteem needs; 


e.. 


self-ac tualization. 



Essentially, the theory suggests that as the lower-order needs are satisfied^ 
an individual's higher-order needs become the motivating force, and that only 
to the extent that an organization can provide Individuals with opportunities 
of satisfying these higher-order needs will the behavior of an individual be 
conducive with management's expectations. This is true, according to Maslow 
and followers, inasmuch as the lower-order needs, physiological and safety, 
have been fairly well taken dare of in our society. 

McGregor develops what he calls Theory Y, lu contradiction to Theory X, 
based on Mas low's motivational theory to account for work behavior. Theory 
X, according to McGregor, is the conventional mai^^gerial position that pro- 
poses to deal with human behavior, based on assumptions about the nature of 
man being indigent, lacking ambition, inherently self-centered, disliking 
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1- 1 5^* "^"T ^* ««n«l.erlal 8«he« that would fellow 

would place m nanagenent the responsibility for organization, direction. 
J^M^S; ftivatlng the behavior of people in the organiration to 

satisfy the needs of the organization. One controls this behavior by 
persuasion, reward, and punishment. 

Theory Y. on the other hind, is based on Maslow's needs, and the goal of 
«anageaent then would be where. . .the motivation, the potential fof 
developing the capacity for assuming rcBponalbillty . the readiness to 

'^T"** goals, are ,11 present in people. 

^ZTTr then, there. It is the responsibility of ««.geoe„t 

iLr^ fi J* P*"^^* ^° recognize «,d de>«lop these hu«n character- 

l^ATr, i "sential task of »mag«.ment 1. to arrange 

K ! f ''.f'^^oj^ of oper-tion so that people can achieve their own 
««;^Hf ^ ''^"'^""^their own efforts to org«iiz4tion.l objectives, 
essentially a process of creating purpose, releasing potential, and 
removing obstacles." Probably fanjLliar topmost management people in the 

'^'**""f conditions of "Management by Objective.." Way. in which 
Theonf Y can b? implemented are through some notion, ^f decentralization. 

; ^""^ «°l"8«««t. participation in^the decision 

process, and throu^ performance appraisal. 

1 ^ considerable amount of literature is available atfesting to the 
value of Maslow's Theory. Yet I am aware of very little supporting research 
evidence. With the exception of work by Chris Argyris. I am aware of no 
studies conducted in an induscrial or business context that are supportive 
of Maslow's need theory. Yet so much of what occurs in tt.e field of manage- 
ment training is predicted on the validity of this approach. 

Herzberg's (1959) 2-factor thecry postulates that the factor, responsible 
III !n5Jr *" those intrl,^lic to the Job itself, namely achieveaenr. 
recognition, responsibility, opportunities for advancement. The extrinsic 
factors or hygi€inic factors such as pay. supervision, human relatiooahips. 
coBpany policies, working conditions, and Job security, are not important 
t'!.l!'T .ustaining or di . cting one's efforts, but are concerned 

with the prevention of job dissatisfaction. The intrinsic factors or 
motivators haveno influence on job dissatisfaction, but operate only to 
Increase Job satisfaction. Most of the rrrearch surrounding Herrberg's 
-i-factor theory has been concerned primarily with the factors as they con- 
tribute to job satisfaction or dissatisfaction, and not to the role of intrinsic 
factors serving as motivators. Without going into details. I tend to view 
Herzberg s notions as oversimplifications of human behavior and a., in many 
instances, highly irrelevant to an appropriate understanding of motivation. 

««« ^I?**"^ of McClell«id and Atkinson. 

J^non i'^MoIi^ McClelland. In his study of enterpreneural behavior. 
McClelland (1961) makes the distinction between such behavior ind the brtiavlor 
of entrepreneurs, who he defines as someone who exercises some control over 
the means of production and pvoduces more than he can consume in order to 

"<=Clelland'8 investigation demonstrates a significant 
relationship between the level of entrepreneural activities and the degree 
Of economic growth attained during the particular period that was studied. 

't, 
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Basing Ills work on Maslpw's need theory, data are presented to support the 
notion that individuals who are high In need for achievement (« ach) tend 
to be tDore likely to be engaged In occupations of an entrepreneuTSl nature than 
those who are lower In n adi. Su-h Individuals also, according to McClelland, 
tend to be moderate risk takers. Innovators, and assume greater responsib- 
ility. Since the methods used by Murray, namely the TAT, also measure need 
for power (n £> anS need for affiliation (n aff) , McClelland also hypothesizes 
that the high acievlng individual will also possess high n p and low n aff. 
.1 am not aware of many studies that have attenpted to relate n ach to'pe^ 
foroance except those that tend to show that individuals in e'^T^lve positions 
tend to have higher n ach scores than those lower on the managerial hierarchy. 
There appears to be, in the popular literature, a desire for capitalizing 
on individuals with high need for achievement. The researchers are not in a 
position at this time to show that individuals with high n ach scores are more 
likely to have higher levels of motivation than individuals with low n i -h 
scores^ — ■ * 



The content theories, in general, postulate a need system that views 
man as a creature with aspirations toward angelhood that are prevented from 
fulfillment due to the restrictive nature of the environment in which he 
works, and that if only we could recognize this, we could then redesign the 
organizational structure, redesign Jobs, allow individuals to have greater 
mastery over the decision-making process, etc., and thus approximate a new 
Utopia of work. This notion about the nature of man, in my opinion, is much 
too simplistic, for it ignores what many psychologists hav6 deemed a signifi- 
cant motivational force, namely fear or anxiety. It ignores, also, the need ' 
for power that many individuals apparently possess and, in general, falls to 
recognize diverse theories that deal with man's behavior. Specifically, I 
''k. u 5^ personality theories that have evolved over recent yfears 

which while they have not directed their attention* specifically toward 
work behavior, some have developed notions that can, in general, subsume 
most of the ideas put forth under content theories of motivation described 

u ^ ^^^^ specifically to the early work of Solomon Diamond 
vl957), who developed a notion of temperamental dispositions of affll- 
lativeness, aggresslvlty, fearfulness, and Impulslvity a^ the basic under- 
lying dimensions of temperament that evolve into the complex personality 
structure that one finds in an adult. . 

I have not attempted to relate the large nunber of empirical studies 
that have attempted to correlate significant variables (such as pay. Job 
design, leadership) with performance measures that have been used to support 
or negate the various theories. These will be covered in the remalninR 
part of our conference. 

Researchers have come a long way in industrial psychology frem the 
time when the cry was that no theoretical work exists in the field, but rather 
a massive collection of empirical data that had little if any generallzablllty. 
Those who feel that there have been too many theories developing in the 
last few years and not enough empirical evidence in support of them will, 
in the future find their concerns minimized, as historically, theories 
of validity survive and develop their usefulness, while others may be 
fashionable at some point in time but without supporting empirical evi- 
dence Jend to fall in disrepute. Perhaps a conference on Motivation to 
Work that occurs in the 1980 's will show which of today's currently 
fashionable motivational theories are wortjhy of survival. 
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CURRENT PERSPECTIVES IN MOTIVATIONAL RESEARCH 
William K. Graham 

Motivation la a topic surrounded by controversy In virtually all areas 
Of psychological research. The intention of this paper is to cosnent on 
motivation research and practice within the field of industrial and organi- 
zational psychology. " 

Part of the recent increased interest in motivation among industrial 
and organizational psychologists stems from the rather controversial view 
that a new anti-work ethic is emerging in the United States. Newspapers, 
magazines, and television programs have carried feature artfcles and docu- - 
oentarles along the general theme that workers are becoming alienated to the 
point of rebellion. A recent Health. Education and Welfare report concluded 
that workers are growing restless because of "dull, repetitive, seemingly 
meaningless tasks, offering Uttle challenge or autonomy." Along these same 
lines, a frequently cited study by Shepard and Herrlck of 400 male union 
members concluded that one third were so aUenated that shorter working 
hours, longer vacations, or even more money would not help. The work of 
Korahauser (1965). among others, implies that certain types of work ought to 
be put on the Surgeon General's list as injurious to health. 

addition to the nature of the work itself being a cause of alienation, 
it is often noted that the labor force is younger, better educated than ever, 
that it contains longhalrs and radicals, even some Berkeley students, and that 
there has been a decline in the proportion of workers who gained their maturity 
in the shadow of the depression. 

While all of this is undeniably true, the changing work ethic hypothesis 
is grossly overstated. By and large, most of the evidence for the emergence 
of an anti-work ethic comes from 'the one million or so urban workers engaged 
in short cycle, mass production asseadily line work in which there is virtually 
no contndover work pace (Walker & Guest. 1952; Blauner. 1960; Komhauser. 1965; 
Seashore & Bamow. 1972). This is not to say that the problem is an unimportant 
one. but its magnitude is at least partially diminished when it is recognized 
that the labor force contains in addition some 28 million blue collar workers. 
41 million white collar workers, and 13 mllUon service and farm workers. The 
beneficial impact of the changing work ethic hypothesis has been to focus 
attention on the nature of work, the tasks people are asked to do. and to 
stimulate thinking about how jobs, the job environment, and work incentives 
Mght be redesigned so that people are able to enjoy their work more and do 
It better. 



An older and apparently less controversial hypothesis concerning the 
motivation of workers has been labeled the personality versus organization 
hypothesis (Strauss. 1962. 1973). While this hypothesis has been stated in 
a variety of ways, the common theme is that there exists a basic, virtually 
inevitable conflict between Individual and organizational needs. Elements 
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of this hypothesis can be found in the works of people such as Argyris 
(1957), Maier (1955), and McGregor (1960). As Strauss (1973) has noted, 
the underlying rationale for the hypothesis goes sor^thing like thist 

(1) In their affiliation with an organization, workers seek social 
belonging, independence, and personal growth. To use Haslow*s (1954) terms, 
workers seek to loove up the need-hier^chy from physical through safety, 
social, esteem, to' self-actualization needs, (By •*hierarchy''is meant that 

a higher, less basic need does not provide notivation unless, lower, more 
basic needs are satisfied, and that once a basic need is satisfied, it no 
longer motivates.) An io^ortant part of his underlying assumption is that 
these needs must be met on the job . 

(2) The control structures in organizations are set up in ways which 
fail to recognize individual needs and instead arc designed according to 
"Theory X*' (McGregor, 1960) assumptions that people are basically lazy, that 
they dislike work and, when given the chance, will do what they can to avoid 
responsibility.. Acceptance of these assumptions has led organisations to^ 
develop methods of supervision and control which force workers to beha\e 

in an immature and dependent fashion. 

(3) Because they are cau^t in an inflexible, oppressive system that 
does not permit the fulfillment of higjtier order needs, workers become 
alienated from their jobs. This alienation hay be expreaaed actively throu^ 
increased union activity, strikes, restricticid of output, or even sabotage. 
Alternatively, alienation may be expressed In' relatively passive wiq^s throu^ 
withdrawal, lack of interest, or an unwillingness to do anything more than 
meet the minimal requirements of work. In any case, the response of the 
Theory X organization is to tigihten up its control system, to supervise more 
closely. As a result, workers become even more frustrated and the likelihood 
is increased that they will work against the organization rather than for it. 

(4) Finally, the personality versus organizaticm hypothesis suggests 
that the way to get out of this vicious cycle is to build control systeos 
based oA "Theory Y" asstmaptions. Namely, that given the chance people can 
enjoy work, that workers can exercise self-control, and that work should be 
organized in ways that allow people to express their imagination and creative 
talents. The general prescription is that organizations should promote job 
enrichment, relaxed, more general supervision, and that they should encourage 
the development of ccAiesive, semi- autonomous work groups. This - so the 
forimila goes - will lead to more challenging work, greater intrinsic job 
satisfaction, and to individual growth. 

Admittedly, this presentation of the personality versus organization 
hypothesis is a grossly oversimplified characterization. It represents a 
kind of oKmtage of ideas snatched from the human relations movement, the 
so-called human potential movement, and from what Casf^bell, et al. (1970) 
have labeled "content" theories of motivation. However, the characterization 
encapsulates fairly well the thinking of many recent MBA graduates and 
organization development specialists. 
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Content theories of notlvatlon are pretty much in agreement with the 
personality versus organization hypothesis. Whether one chooses to adopt 
Maslow 8 (1954) need hierarchy theory or Herzberg's (1959)- line of thinking, 
the kinds of changes one would strive to make in an organization would be 
the same. An exception might be McClelland's (1953, 1961) nAch Theory. 
McClelland s work suggests that individuals differ in their needs for achieve- 
ment, affiliation, and power. Moreover, evidence suggests that these needs 
can be altered through training. Thus, McClelland has found tHat in a 
relatively short training program, nAch can be increased (and, presumably 
decreased). While McClelland's work is usually i resented as an illustration 
of how individuals can be induced to desire success and take on challenging 
tasks, similar techniques might be developed to put up with basically 
chaUengeless work. This is not meant to advocate; rather, it is to point 
out what is seen to be an important difference between McClelland's approach 
to motivation and the approadi represented in the thinking of Maslow and 
Herzberg. 

• 

- Among those who accept the personality versus organization hypothesis, 
.and also among content theorists, the tendency has been to blame the environ- 
ment, specifically the organization for any motivation problems that ml^t 

probably the case, however, that there wlU always be some 
workers who even in the best conditions will lack the motivation to work. 
As Porter and Lawler (1965) have suggested, in arguing that we should focus 
more attention on the complex Interactions between individual difference 
varld>les and environmental factors, "Too mudi previous theorizing In the 
area of organizations has neglected . . . interaction possibilities and hence, 
there has been an unfortunate tendency to oversimplify vastly the effects of 
particular variables.' Organizations appear to be much tpo cc^lex for a 
given variable to have a. consistent unidirectional effect across a wide 
variety of types of conditions (p. 48)." 

Uchtman and Htmt (1971) in suanarlzing the utility of content type 
theories concluded: "The virtue of the one-sided versus the eclectic approach 
depends in part on the purpose of the theorist. If his purpose is to convince 
bureaucratic managers of the advantages of human relations practices, there 
is pro1>ably no harm in taking a more extreme personalistic view of human 
behavior in organizations. If, however, the theorist's intent is to build an 
accurate and workable general model of organizational functioning, then it is 
clear that none of the one-sided (content approach) views proposed to date 
can do that job (p. 282)." 

Herzberg 's (1959) two-factor theory, althougji not clearly a theory of 
motivation, deserves special cwnment. As Campbell, et al (1970) have 
indicated, "^ . . the two-factor theory has been argued with a good deal of 
eloquence and also presents a manifestly 8iiq>le hypothesis to test. It has 
stimulated a great deal of research (p. 380)." Of course one reason it 
has stimulated so much research la that behind the eloquence and surface 
simplicity one finds a good deal of latent coiq>lexlty and confusion. King 
(1970), for exaoq>le, has pointed out that at least five distinct versions 
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of the two factor theory have been stated or implied in the literature. 

Thus, the two- factor controversy, which has generated considerable negative 

evidence and almost an equal amount of support, is overshadowed by the vague 

and sometimes different interpretations of the theory by various researchers. 

In a recent study. Waters and Waters . (1972) tested all five of the versions 

of two- factor theory outlined by King and failed to find support for any version. 

Let us turn now to theories of motivation which emphasize process rather 
than content. Namely, equity theory (Adaii», 1963, 1965), expectancy theory 
(Vroom, 1964) and social learning theory (Bandura, 1969, 1971). * 

According to Adams (1965) people experience inequity when they perceive 
that the ratio of their outcomes to inputs differs from the outcome«-input 
ratio of others with whom they compare themselves. This may occur when they 
are In a direct exchange relaticmship with comparison persons or when they 
and their comparison persons are in an exchange relationship with a third 
party (p."" 280). Outcomes may Include such things as pay, fringe benefits, 
status, etc. Inputs include how bard the pexscm works, educational* level aind 
general qualifications. The relation that determines the inequity of anjr 
particular Input-outcon^ balance is the person's perception of what he is 
giving and receiving even thoug|i this perception maj not correspond with 
the perception held by others. The theory stresses that the presence of 
inequity will motivate a person to achieve balance or to reduce inequity and 
that the strength of the motivation to restore equity will vary directly with 
the perceived magnitisde of the Inbalance between input-output ratios. Research 
In the area of equity theory has dealt primarily with compensation practices, 
particularly with how quantity and quality of work are affected when people 
feel that they are being underpaid or overpaid* 

Equity theory is a good deal more complex than one mlg^t initially 
think. Welck and Nesset (1968) have listed six ways that perceived input- 
outcome ratios can lead tjo feelings o^'d^nefluity . To these let us add two 
more which, so far as it \^ known have no been treated in the literature. 
Both Involve cases of lnveitB€^.,.Eatios . For example, it seems reasonable that 
a person would experience inequity if he perceived his Inputs to j)e low and 
his outcomes to be hl^ when the comparison other is seen to experience the 
opposite, i.e., low outcomes with high Inputs. Similarly, If the individual 
views his Inputs as high and experiences low outcomes when the coiq)arlson 
other Is seen to have low Inputs and hl^ outcomes, I suspect there would be 
feelings of inequity. 

Equity thepry is closely related to social comparison theory and dissonance 
theory (Festlnger, 1954; 1957) and, not surprisingly, it suffers from some of 
the same problems. Very little is known about the degree to which people 
differ in their tolerance for inequity. Moreover, the theory falls to specify 
how people select comparison persons. However, if people do in fact strive 
to reduce inequity, there might be a tendency to select people who hav ^ a 
similar input-output ratio. Laboratory studies of equity theory have 
generally been set up in ways which restrict the selection possibilities to 
those which lead to inequity. 
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Among the process theories of motivation, expectancy theory has 
received the greater attention by industrial and organization psychologists* 
Historically, the theory may be traced to the work of Tolman (1932) and 
Peak (1955) . It is also closely related to subj ective Expected utility 
theory in the area of decision making* The promlnance of expectancy theory 
in industrial and organizational psycholcgy is due tc the work of Vroom 
(1964) and Porter and Lawler (1968). Critical evaluation and elaborations 
of expectancy theory, which also goes under the nai&e of path-goal or 
instrusientality theory, have been presented in recent papers by Heneman and 
Schwab (1972), Graen, (1969), and Mitchell and Biglar (1971). The basic 
notion in expectancy theory is that the expenditure of energy is a joint 
function of a person's subjective expectancy that his behavior will lead to 
particular outcomes and the value he places on those outcomes. If, for 
example, a worker places a hi^ value on money and also perceives that the 
probability of obtaining money is linked to the nund>er of widgets he pro-- 
duces, other things being equal the likelihood is increased that he will In 
fact turn out more widgets. Unlike content theories of motivation, expect- 
ancy theory makes no assu]iq>tions about the specific needs people strive to 
fulfill. The theory allows for individual differences in the kinds of needs, 
the number of needs, and percelj/ed links between rewards and needs. An 
advantage of expectancy thebry is that it suggests different methods for 
modifying iehpvior. For exan^le, according to the theory, behavior can be 
changed*^ altering perceptions of the link between behavior and outcomes 
or by influencing the perceived value of outcomes. 

In spite of these advantages, expectancy theory does have its problems. 
One problem has to do with the independence of the desirability of rewards 
and the perceived probability of obtaining them. While theoretically it is 
possible to think of these as being independent they may be psychologically 
dependent, and perhaps more so in some individuals than in others. People 
do seem to differ in the degree to which they engage in wishful thinking. 
Thus, there is some evidence that one can predict behavior merely by summing 
the expectation component of the theory leaving out the probability judgments • 
What may be happening is that in paper and pencil tests of the theory, 
expectations become modified by probability judgments in the heads of sub- 
jects before they are recorded on, questionnaires . 

A second problem is not so much a criticism of the theory as it is a 
general fault cf the methods used to test it. Althou^ expectancy theory 
suggests that the nunfcer and kinds of expectancies may vary from one /person 
to the next> the common research practice is to provide subjects with a list 
of possible rewards together with some scales for making desirability and 
probability judgments. While this is a convenient research practice, it- 
does not constitute a proper test of the theory and actually amounts to a 
crude form of averaging where there should be summation. 

This brings us to a third problem, namely the question of whether it 
makes theoretical sense to sum the products of reward values and their 
probability of occurrance. To do so suggests that the rewards are independent; 
that each makes a unique contribution to energy expenditure. There are 
doubts about this assumption but whether it is of practical significance is 
a question for future research. 
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Finally, discussions of expectancy theory In the literature tend to 
adopt an almost exclusively normative approach Involving the comparison 
of absolute levels of values attached to rewards by different groups or 
daises of workers. However, expectancy theory suggests that one should 
look at the relative values attached to rewards by Indlvl-dual subjects. 
A procedure for Investigating this question is discussed in Professor 
Zedeck's paper. 

These problems notwithstanding, if I ware pressed to choose among the 
prominent theories within the field of Industrial and organizational psych- 
ology I would, without hesitation, choose expectancy theory. However, I 
am not sure that I would take this position next week, increasingly 1 
find myself attracted to Bandura's (1969, 1971} social learning theory 
approach. 

As a rule 1 have not been particularly enamoured of approaches to 
motivation derived from learning theories. This is partly because they 
require one to generalize from the behavior of ratd to the behavior of me^ 
But it Is also because most learning theories seem far too simple to be / 
applied to complex social situations and because of their near exclusive/ 
enqphasia on reinforcement through tension or drive reduction. In Bandura*s 
theory, however, I find none of these undesirable characteristics. His/ 
theory is based on and supported entirely through research with human £^b- 
jects, The theory emphasizes man*s capacity to learn large Integrated /units 
of behavior by observation, without having to build up the patterns by trial 
^and error. There is also a place in the theory for man*s cognitive okpaclty 
through which external influences can be represented sysfcollcally • Finally 
there is recognition of self-*regulatlng Influences, i.e., men are sejen as 
able to control their own behavior to some extent by managing the stimulus 
determinants of activities and producing consequences for their own actions. . 
According to the social learning view, . . . "man is neither drlve^ by inner 
forces nor buffeted helplessly by environmental Influences. Rather, psych- 
ological functioning is best understood in terms of a continuous yreclprocal 
interaction between behavior and its controlling conditions (Banaura, 1971, 

p. 3)." ^ / 

■I 

Whereas in traditional learning theory the reinforcement works back- 
wards to strengthen preceding ^responses, the social learning ^proach argues 
;:hat informing the subject in advance, particularly in observational learning 
' situations, about the payoff value for some behavior, rather than waiting 
for the behavior to be exhibited, will result in a faster learning sequence. 
Bandura*s ''anticipations** appear to be analogous to Vroom*s "eicpectancies,** 
hl3 **lncentlves** appear to be analogous to Vroom*s "valences*** For expectancy 
theory and for social Jearnisig theory the Incentive or valence serves a 
stimulating fuxictlon to either create attention or direct action. Thus, 
social learning theory seems U^o Incorporate majoV elements of expectancy 
theory. On the surface, at least, it would seem that a merger of these two 
theories might prove very fruitful. 
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Let us shift gears now and speak about motivation from a slightly / 
different perspective. In working with organizations I have been inqpressed/ 
by the frequency with which problems in the area of motivation are mentioned. 
Quite often, hqwever, when managers are asked to describe the problems in / 
detail they have difficulty spelling out precisely what people in their 
organizations should be doing to demonstrate higher levels of motivation. 
Recent papers by Nord (196.9), Jablonsky and DeVries (1972), and Porter (1973) 
have advocated the use of operant conditioning techniques to modify the 
behavior of workers. Although operant techniques have been used in class- 
rooms, prisons, and hospital ward^Hhey have not been used to any great 
extent in business and industrial settings. As Nord has suggested, "Modem 
Americans, expecially of the managerial class (including some organizational 
psychologists), prefer to think *f themselves and others as being self- 
actualized creatures operating near the top of Maslow's need-hierarchy, 
rather than as animals being controlled and even 'manipulated' by the 
environment (pp. 376-377)." Nord attempts to soften the blow by suggesting 
areas of overlap in the thinking of Maslw, McGregor, and Skinner, and by 
pointing out that each is interested in changing environmental conditions 
to produce changes in behavior. 

Jablonsky and DeVries (1972) describe the presence of multiple reward 
and punishment contingencies in the work environment and individual differ- 
ences in the effectiveness of reward contingencies. This leads them to a 
model of motivation which is essentially a combination of operant condition- 
ing principles and expectancy theory ^ According to the model, . .an 
individual ^ithin an organization is surrounded by several urique social 
environments, each of which applies a ppssibly unique set of reinforcement 
contingencies for each of several behavioral alternatives. In addition, 
the model recognizes that the final forces for behavioral change result from 
interactions between multiple reinforcement contingencies ai.d the values an 
individual places on the various reinforcements (p. 354).. 

Thinking in operant terms leads one to specify the behaviors to be 
modified and to identify the available reinforcers. In work organizations 
the behaviors to be modifie(| are generally such things as absenteeism, 
tardiness, or the quantity or, quality of output. Identifying the reinforcers 
requires a bit more imagination, particularly when it comes to setting up 
reward contingencies. As Porter (1973) has pointed out, modem organizations 
are relatively quick to alter the work, environment when it comes to the intro- 
duction of new technology. Yet these same organizations have "... come to 
believe that compensation, work and non-work schedules, perforr*ance feedback, 
and other similar elements of the work environment are sacred cows that must 
not be disturbed lest changes create worse projblems than they were designed 
to solve." Porter argues that organizations in the future must recognize 
that work environments are highly adaptable and will have to be restructured 
so that rewards relate to specific behaviors. 

Generally, there seems to be a growing interest in the application of 
operant techniques. The United States Army, for example, has employed contin- 
gency management systems for basic training. Datel ^nd Legters (1970) 
developed a token economy reinforcement system involving a variety of military 
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training activities such as barracks Inspection, standing formations, rifle 
range training, and so on. Officers and noncoms were taught to punch sped- 
fled areas on the trainee's card when relnforcenient criteria were net. When 
enough points were accumulated they could be exchanged for privileges such as 
weekend passes or movies. Emery Air Freight claims to have saved 2 million 
dollars in their containerized-shipment operation through the use of contingency 
management, feedback graphs and checklists. 

If organizations can be pureuaded to loosen up a bit and begin to explore 
reinforcement contingenclng and alternative reward systems, the future of 
motivational research looks very bright. 
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A RESEARCH IWDEL FOR MEASURING MOTIVATION: A SUGGESTED APPROACH 

Sheldon Zedeck 



The IntenC of this presentation is to briefly discuss the underlying 
notions of one model. that has been used by behavioral acientists in the 
study of motivation and, then to describe, in sooevhat greater detail, a 
suggested, but as yet untried » approach for studying aotivation that over- 
comes the Inadequacies of the traditional approach. The differences be- 
tween the traditional and the suggested approach are basically ones of 
perspective and focus . To preview, it wixl be proposed that notivational 
research be examined from the perspective of decision making or Information 
processing models and that processes pertaining to with in-^ind ivldual assess- 
ments be esqphasized. 

Definition of Motivation 

Prior to a discussion of research models, it is necessary to define 
the term "motivation." An accepted definition is proposed by Vroom (1964) 
who defines motivation as". . , a process governing choices made by persons' 
. . . among alternative forms of voluntary activity." A more elaborate 
definition is proposed by Campbell, Dunnette, Lawler, and Weick (1970). 
Their position is ". . . that an individual's motivation has to do with 
(1) the direction of his behavior, or what he choo6U (italics mine) to do 
when presented with a number of possible alternatives; (2) the amplitude , 
or strength of the response (I.e., effort) once the choice is made; and, 
(3) the pertsistence of the behavior, or how long he sticks with it. The 
term "motivation^* conveniently subsumes a nusiber of other variables such 
as drive, need, incentive, reward, expectancy, etc.'' (p. 340). The key 
notion, for this presentation, in these definitions is "choice among 
alternatives." 

According to Campbell et al . (1970) there are two approaches to 
classifying motivational theories: (1) mechanical or process theories; 
i.e., explaining and describing the piocess of how behavior is energized, 
how it is directed, sustained, etc., and (2) substantive or content theories 
i.e., identifying loiuit it l$> i^tlUn an indlv^daat (italics mine) that 
energizes and sustains behavior. The key notion in this classification 
scheme is the "process within an individual." 

One example of a process theory is Vroom* s (1964) instrumentality 
theory.' Vroom argues that the motivational force or effort an individual 
e^evta is a function of (1) his expectancy that certain outcomes will 
result from his behavior and (2) the valence (strength of preference), for 
him, of those outcomes. The valence is a function of its instrumentality 
for obtalninjg other outcomes and the valence of these other outcomes. 
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Vroom represents his basic model mathematically as F . « f E (E V ) 

where is the force to perform act i, E is the strength of the , 
expectancy that act i (e.g., working hardj-'will be followed by outcome j 
(e.g., high salary) and V is the valence of outcome j. The key notion 
in this representation is^that motivation is explained by a process in- 
volving "summation within an individual." 

To Integrate the above brief review of common explanations of moti- 
vation, note what Is Implicitly or explicitly postulated. The first concern 
*® Individua l's processes ; not group behavior, not average behavior, 

but how an Individual perceives his environment. Second, as Indicated in 
Vroom 8 mathematical expression, we are concerned with sumning effects 
within an individual. Thfe cross product of E. .V and the sumnation of 
these results indicate that the force to act ,^i!iohvation, is a function 
of many factors, possibly of dlffer;entlal relevance within the individual, 
and their interactions. 



Third, ^he explanations enphasize that choice is Involved. In essence, 
the individual is faced with a decision-making task. Given alternatives, ^ 
how does he act? For exanple, given that an individual is presented with a 
certain salary, some security, a high prestige position, and an intrinsically 
Interesting job, will he join one organization rather than another? 

Fourth, the above explanations indicate that motivation can be studied ^ 
by examining potential alternatives and their effect on behavior. In other 
words, independent variables such as rewards, incentives, needs, drives, 
etc., and their relationships to dependent variables or responses such as 
effort, performance, persistence, coimnitment, etc., should be examined. 
Motivation is a process. This process Involves a consideration by the 
individual of the independent variables in conjunction with a decision 
(response). It is not an isolated process. When we ask someone, '%ftiat 
is important?" we indicate '*iin)ortant for what." The implication of this 
for the study of motivation is that a relatively simultaneous investigation 
of independent and dependent variables might be more fruitful than doing one 
study on independent variables and then a subsequent study focussing on 
dependent variables. 

0 

To summarize, the Implications of the motivational definitions for 
motivation research is straightforward; it is the examination of the 
relationship between independent variables and dependent variables for an 
individual faced with a decision-making task. Any motivational theory is 
valuable for understanding and predicting behavior if it can identify the 
important variables and the processes by which they influence behavior. 



How Motivation Has Been Studied: The Underlying Notions,. 



What has been the basic model for the study of motivation? Tradi- 
tionally, researchers have been concerned with the importance of certain 
job characteristics, the needs of workers, preferences for rewards, job 
satisfaction, and the relationships between performance and rewards. 
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This presentation will emphasize the identification o£ goals » needs, 
etc., and their importance. The research in this area has generally used 
rating scale data. Respondents are requested to indicate the iiiq>ortance 
of various facets, intrinsic or extrinsic to the jobs. Each facet is con- 
sidered without regard to its relationship with other facets. Results of 
this process are usually averaged and analyzed in terms of group data. 
That is, we will find the average importance of salary, the average im- 
portance of security, etc. Comparisons between groups, e.g., levels of 
management, between white collar and blue collar, successful vs nonsuccess- 
ful, etc., are then made. 

Examine this design. Individual A provides the information about 
the importance of salary, possibly with respect to whether he remains with 
the organization. By examining his data relative to other menbers of his 
group, for that is the averaging process, statements can be made with 
respect to whether his preference for salary is higher, lover, or about the 
same as the model member of his group. This averagii^ process for other 
rewards, etc., is repeated. In the end, there will be normative coiqiarlsons » 
such as, salary Is more important to Individual A than it is to other indi- 
viduals in the group, whereas security is less important for Individual A 
than it is for other numbers of his group. Importance has thus been measured 
on an absolute scale. 

To maximally utilize the data and analytical strategies, take the 
average i]i(>ortence of salary for one group, e.g., upper management, and 
compare it to that of lov^r management. In other words, differential im- 
portance has been examined based on clusters of groups formed and the 
a priori condition of level in the organizational hierarchy. 

The same analyses are performed and conclusions drawn regardless of 
the procedures used to collect the data. Other procedures besides rating 
scales are projective tests, interviews, and self-report questionnaires. 
Basically, the data collected have been analyzed according to a normative 
model, or between group COT^>arisons. These analyses have been done at the 
expense of within person data and within person comparisons; the comparisons 
really dictated by the definitions and representations of motivation. That 
is, the concern should be with the importance of one goal relative to the 
Importance of other goals for the same individual . 

Recently, Blood (1973) presented a strong argument for within person 
comparisons. Blood argued that an individual responds to his work environ- 
ment according to his personal hierarchy. Knowing that A has a lower pre- 
ference for salary than B is not extremely useful. Rather, it Is important 
to know that salary is most iiq>ortant for A relative to other possible 
rewards. In other words, relative position of rewards, preferences » motives, 
etc., within an Individual is the crucial aspect. 

Why is within person information valuable? One basic answer is that 
it allows us to reward differentially. That is, if a person's most preferred, 
reward is salary, then the organization may use money as a motivator for 
him. If a person's most preferred reward is extra vacation, then the 
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organization may accordingly reward him* Reward scheBies can be adopted to 
fit the Individual. Normative analyses stress group or average data. 
Within liersoa analyses s'tress the Individual, the entity that motivational 
definitions focus on. 

From the organizational viewpoint, it would be most beneficial for 
the organization to identify those subgroups who have similar personal 
reward preferences or hierarchies. Those irtio have the aaaie rank order for 
preferences could be treated similarly by an organization* Analyses that 
would result in identifying groups of workers that have similar preferences 
are ipore valuable than knowing that upper managers, on the average, have a 
greater preference for salary than middle managers. 

The actual research task used by Blood (1973) for scudiylng within 
person preferences requires choosing among alternatives. Data are collected 
in a paired comparison format resulting in ipsatlve scores. That is, there 
is a fi..ed quantity of points among ten dimensions (rewards) specified. 
For each individual, the total score over all diwnslons is equal. 

The data obtained from the use of the Ipsatlve procedure, however, is 
in some respects treated as normative data have been. Groups formed a priori 
on the basis of, e.g., organizational level, are then cooqiared, byiuse of a 
multivariate t test, for differences in importance of the set of 10 variables. 
The results may tell us that there is a different average ranking of the 
dimensions between the two groups. But, do such results imply that iq»per 
mailagers should be rewarded by one scheme and lower managers by another? The 
answer is not really known. It is possible that one sid>group of 19 per mana- 
gers would require one scheme; a reward scheme that mi^t be similar to one 
offered to a subgroup of lower managers. The multivariate analysis might be 
masking within person differences. Thus it migjht be better to statistically 
identify dutfzers or groups who haire similar preferences rather than from 
groups on an a priori basis. 

At this point, several shortcoming in the traditional approach for 
the study of motivation should be noted. First, most research has been of 
the survey type where the focus has been on variables that could be referred 
to as independent variables. Assessment of dependent variables and how they 
relate to the independent variables has often been igsiored. What would be 
desirable is a simultaneous assessment of the relationship between indepen-* 
dent and dependent variables. Second, within person compariaons have been 
ignored. Where %rithin person coaparisons have been emphasized (Blood, 1973), 
analyses may not be complete. The relationship between within person com* 
parison information and meaningful criteria have been ignored or the within 
person data have been analyzed according to normative models. What is needed 
is a research approach that identifies the inportant influences (motives) 
that are related to behavior (decisions) and that identifies individuals who 
have similar relationships. 

Basic Research Model 

The proposed research model for motivational research is drawn from 
those used for the study of information processing in Judgpent. The 
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motivational problem is one of determining the factors causing behavior 
within an individual. To the extent that an individual can understand 
and assess information or alternatives available » he does so through 
application « of an implicit or explicit policy and the relation of his 
goals to that information. The policy that motivation research should be 
concerned with is the individual's set of. rules for utilizing available 
information^ or consideration of alternatives » in order to reach a decision 
or energize behavior in a situation* 

The concern in the remainder of this presentation is with human judg- 
ment and decision making pertaining to motivational research and. In par- 
ticular, with the processing of information that precedes and determlnes- 
these activities* The focus will be on a way of determining the processes 
and strategies that persons use in order to Integrate diverse bits of 
information about outcomes Into a force to perform an act* 

TWO basic approaches have been used to study information processing, 
regression (correlational analysis) , and Bayeslan analysis (Slovic & 
Lichtenstein, 1971). The regression approach will be adopted for this 
presentation. 

The basic paradigm is a correlational one* Judges make quantitative 
evaluations of a number of stimuli » each of which is defined by one or more 
qualified cue dimensions or characteristics. In motivational terms » the 
concern is with the evaluation of out comes » rewards ». incentives » needs » 
etc. 9 in a decision to expend effort » make a choice, or perform — three 
dependent variables in motivational research mentioned by Campbell et al * 
(1970)* With respect to terminology , cues are the rewards » Incentives » 
motives, etc*» whereas Judgment or the criterion isc the choice, decision, 
effort, or performance* 

Since regression analysis is being used, how the relatlcmshlps operate 
can be seen by examining correlation coefficients* The correlation coeffi- 
cient betmen cues and the Judgment reveals the subtle, inferential 
activities of the inferring person* The coefficient represents the relative 
degree that the judgment depends on the various cues or alternatives or 
rewards available to the decision maker* It does so without asking the 
respondents to explicitly evaluate the rewards; all is inferred from examining 
the dependent variable, the decision* At no time does the individual have to 
overtly respond in regard to the rewards* At no time does he overtly make 
value judgments about the rewards. In brief, it is possible to capture an 
individual's declslon*making policy, set of rules, by using regression analy- 
sis* The purpose of the regression analysis is to understand and describe a 
respondent's idiosyncratic method of combining and weigihting infermdition by 
developing equations representative of his cotublnatorial process* The next 
step is to cluster individuals with similar equations — information necessary 
for effective organizational policy with regard to rewarding its meinbers* 
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The procedure is fairly traditional but with a few contralnts. First » 
the situation is controlled. All Judges or decision makers have the same 
stimulus dinensions available; i.e., have the same Information about the 
task. This information is in a quantititative form. Second » for the 
poses of this presentation, a linear model is assumed; i.e., decisions are 
based on a linear c(»bination of each of the available cues. The equation 
or decision xvle can be i^epresented as: 

^ ^ k 

i«l 

where D is die respondents decision, R are the rewards (needs, motives, 
incentives, etc.) available, and b. are the beta wei^ts or measures^ of 
importance of each reward. (Beta wei^its are arbitrarily chosen as indie- 
tors of importance. Other possible indicators are mentioned below.) 

In the typical regression analysis of informaticm processing design, • 
the input Is in quantitative Informatioii. The respcmse Is a single valued 
assessment about some conceptually continuous variable. An additive model 
that is also static is adopted. That is, the decision rule Is based on 
many trials or decision-making situations and the constraint is that the 
respondent's view of the world Is stable over this period. The rule Is 
based on a least squares crltericm. This, in sum, is correlational- re- 
gression analysis. 

A brief exa^>le presented by Dawes (1971) Illustrates the use of 
- regression analysis for the study of Information processing. The problem 
was to determine policies of a comsslttee charged with graduate admissions. 
There vere four members of this committee. Hie input was (1) Graduate 
Record Exam (GRE) ; (2) undergraduate grade point average (CPA), and (3) a 
quantitative index of the quality of the undergraduate Institute for 111 
applicants. The dependent variable, decision pertaining to admission, was 
a seven point scale ranging from "reject now" to "offer a National Defense 
Education Act or other fellowship." Average ratings vcre used as dependent 
variolas. Multiple regression analysis indicated that the multiple R was 
.78. The highest beta wei^t was associated with GPA, and the lowest with 
quality of academic institute. In essence, the regression equation captured 
the policy used for admissions. This equation can be used in subsequent 
admissions decision situations; the equation, in effect, replaces the 
committee. 

This regression analysis model has been used to study personality char- 
acteristics (Hammond, Hursch, & Todd, 196A) , attractiveness of stocks 
(Naylor & Wherry, 1965), potential for achieving minority group equality 
as a function of legislated and educational opportunities (Summers, 1968), 
beauty of paintings (Holmes & Zedeck, 1973), and other tasks. Some of 
the tasks are real, some are artificial. 
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Betore a specific application of regression analysis for motivational 
research is presented, it is necessary to briefly mention one extension of 
regression analysis for information proteasing and one potential problem. 
The extension is an in^ortant one-it involves developing regression equa- 
tions for each judge rather than one equation for the whole conmittee. If 
each Judge independently makes judgments for each of ill applications, then 
cLrnrrhf 1^°^ * regression equation for each judge which would 

c^Sd be i:v^;ipe'5: " '^'"^"'^ ^'^^^ 

• 

possible to group or cluster judges based on their regression 
.^S^cx**""^ developed by Christal (1968). Dudycha (1970). Nay lor 
and Wherry (1965) and others are based on clustering judges in teri, of 
the homogeneity of their equations. The effect of these procedures is to 
allow us to determine whether 1 or 2 or 3 or 4 different policies for 
admissions exist among the committee aeiAers; i.e.. individual differences 
in the committee with respect to wei^ting policies can be assessed. 

The problem alluded to above pertains to the determination of the 
important cues. Darlington (1968) has proposed several measures for 
detemdning relative weights of variables in regression equations. One is 
the individual validity squared; i.e.. the square of the relationship be- 

""^^ criterion. A second measure is the standardized beta 
weights. A third measure is to examine the amount decreases when a 
variable is eliminated. Hoffman (1960) proposed another measure which is 
^'*il ^ID^'^ ' sum bf the relative weights is 1.0 and. thus. Hoffman's 

measures Sesciibe the relative contribution of each of the cues as a propor- 

liJ^ the appropriateness of all of the 

measures is limited when the cues are intercorrelated. This problem, however 
can be overcome by constructing independent cues, in particular, by producing 
factorial combinations of cues. fiuu«v.xiik 

A bit of evidence on weighting is relevant at this point. Research 
pertaining to self-insight in decision making has indicated that judges 
strongly overestimate the importance they place on minor cues, and they 
underestimate their reliance on a few major variables (Hoffman. 1960; 
Slovic. ,1969). Subjects do not realize that their judgments can be predicted 
by only a few cues. Usually 3 cues account for over 80% of the variance in 
the judges responses. The question thus becomes: Do all respondents use 
the same 3 cues and to the same degree? 

Motivational Research and Policy Capturinj; 

A project which began a year ago was to determine the factors influen- 
cing organizational choice. The emphasis is on organizational choice and not 
occupational choice. What are the factors that Influence an applicant's 
decision to join IBM rather than Honeywell, given that he wants to be a 
coBputer programmer? Or. what are the factors that influence sonieone to 
join the Navy rather than the Amy? 
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This project was studied in the relatively traditional way. Subjects 
were seniors at UCB who were taking interviews at the Placement Center. A 
list (based on a review of the literature) of 17 factors that have been 
considered related to jobs was foroed— factors such as -learning new things, 
aovancement opportunities, variety in work, salary, personal growth, etc. 
These factors are outcomes, needs, rewards, incentives— the independent 
variables. Subjects responded, at the outset of the project, in terns of 
the importance of these factors. Average iiqportance rankings (N - 90) 
Indicated that feeling of worthwhile accomplishment, personal growth and 
development, and learning new things were most inportant. Working as part 
of a team, freedom from supervisor, and high prestige and social scatus 
were least important. Note that the normative model was used. 

After each subject took an interview with an organization, he indicated, 
among other things, the opportunities to obtain each of tie factors in that 
organization. At the end of the year, subjects indicated their most preferred 
organizations, their least preferred organizfttions , and the organization whose 
offer (if any) was accepted. 

The results are not important for this presentation. What is iiqiortant 
are the problems and inadequacies associated with this design and project. 
First, it already has been emphasized that information about individual goals, 
etc., is lost by averaging. Second, the longitudinal study created problems 
since the subjects were volunteers. At the end of the year, only about 25 
subjects were available for data analysis. Many subjects did not provide in- 
fonnation after each interview, many subjects interviewed off cai^jus, etc. 
But most Important, the cues or information provided to each individual were 
not constant within an organization or across organizations. -Tiat is, two 
subjects could be interviewed by the same organization foi the same job. 
Often, they would not be given the same information, possibly because the 
interviewees asked different questions. Thus, they did not have the same 
basis on which to judge their opportunity to obtain some of the goals. Also, 
on occasion, information for the same variable differed; e.g., different 
salaries. Finally, not all companies provided information about each of the 
goals . 



The result of tnis experience is to propose the use of the jregression 
analysis paradigm for the study of organizational choice (choice of branch 
of the armed forces, choice as to whether to reenlist, types of duty desired, 
etc.). The information obtained would be beneficial to understanding both 
the organization and the individual. From the perspective of the individual, 
we learn the factors or goals important for him; from the perspective of the 
organization, it is learned what goals or factors are to be enmhasized or 
rewarded at time of decision making. 

The major step Is to simulate the interview situation. To do this, a 
paragraph that describes Organization X is developed. In this paragraph, 
information mi^it be provided about (1) starting salary, (2) opportunities 
for advancement, (3) special abilities required, (A) work environment. 



ERIC 



309 



3?0 



IV-3.8 



(5) security, and (6) personal growth. These six independent variables 
are used with various parameters in different paragraphs describing different 
organizations — but all tor the same job. The choice of these six variables 
is arbitrary- One paragraph might read as* follows: 

"The starting salary in Organization X for Job A 
is $12,000. Within 6 months, you will be advanced to 
Job B. Advancement could be facilitated if you are 
able to perform t^ (some specialized task). To perform 
Job A, you will have your own work area. If you per- 
form satisfactorily and remain with us for 3 years, 
then you will receive tenure. We encourage and 
financially si^port your participation in working and 
other educational opportunities." 

A paragraph for Organization Y might read: 

"The starting salary in Organization Y for Job A 
(same job as in Organiz ation X) is $10,000. Within 
3 months, you will be advanced to Job B. Ther? is no 
way to advance sooner than that . To perform Job A, 
you will work in the same room as six other persons. 
If you perform satisfactorily and remain with us for 
2 years, fhen you will receive tenure. We encourage 
your participation in workshops — we will permit time 
off but cannot provide expenses." 

A third paragraph for Organization Z m'ght read as follows: 

"The starting salary in Organization Z for Job A 
is $17,000. Within a year, you will be advanced to 
Job B, but only if there is an opening. You will work 
in the same room as three other persons. Performance 
is evaluated every 6 months, with unsatisfactory per- 
formance resulting in dismissal. There is no time 
off to attend workshops or to further your education." 

Many more paragraphs can be written with some realistic combination 
of the six variables. Assigning numerical values for each variable is 
nothing more than a scaling problem. The variables could be developed to 
be relatively independent of each other. 

Suppose 25 paragraphs, or descriptions of organizations, are presented 
to each of 100 subjects. (Number of subjects, paragraphs, and variables Is 
arbitrary for this presentation.) The response of each subject to each 
paragraph is "desirability of joining the organization." A seven-point 
scale ranging from "definitely want to join" to "would not join if it was 
the last organization on earth" could be used. This response is the de- 
pendent variable. Thus, for each subject, 25 responses are obtained. 
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Regression analysis would Indicate the relationship between the response, 
desirability of joining the organization, and the cue information, job ^ 
character is tics . 

The regression equation would provide information about the most 
Important characteristics or factors contributing to the decision about 
desirability of joining an organization. Regression equations would be 
developed for each subject. Clustering programs (Christal, 1968) would be 
used to Identify those subjects who have similar equations, those who value 
the same factors to the same degree. Suppose further that results of clus- 
tering indicated three policies or three sets of equations. Discriminant 
function analysis could then be used to identify those variables that 
distinguish the three policy groups. Demographic, personality, attltudlnal, 
etc,, variables could be the independent variables in tke discriminant 
function. These variables might be considered as moderators of the job 
characteristlc-decisioft relatlonsihip (Zedeck, 1971) or moderators of the 
policies. Moderators indicate siibgroups for whom a relationship between two 
variables exists and subgroups for whom there is no relationship. In the 
proposed project, moderators identify subgroups for whom certain equations 
are appropriate. j 

The organization can xmk this information In one or more ways. First, 
not all information about an ^organization would have to be presented to 
each Individual. This would save time and money. Based on the moderators, 
if someone is a meniber of Equation No. 1, then a certain set of information 
is presented to him. Someone of Equation No. 2 ^receives a different set of 
information (information about different variables^. This might mean that 
not everyone has to be invited to see the plant or ^.actory, etc. ^lot every- 
one would want to tieet the supervisor or the mfctii>er8 of his group. Not 
everyone would want an enlarged job. 

Second, results could indicate that differential rewards would be offered 
to applicants. Applicant A for Job A would be offered a starting salary of 
$10,000 but promotion at the end of three months, etc. Applicant B for Job A 
would be offered $12,000 but promotion at the end of a year, etc. This dif- 
ferential rewarding is similar to Ncaley's (1963) "cafeteria reward scheme." 
Third, the organization could focus its recruitment efforts on only these 
applicants who want the. rewards the organization offers. 
J 

Conclusloy/ 

The regression analysis paradigm is an apprgprlate model for studying 
motivation. The individual is the focus; within person coiq)arl8ons are 
maintained. Also, simultaneous examination of the relationship between 
needs, motives, r&«/ards, and some behavioral aspect is achieved. Finally, 
the organization is able to use the obtained information in establishing 
policies for recruiting and rewards. 

Traditionally, results of these studies have been used to "replace** 
the decision maker with his equation. For motivational research, results 
may be used to determine what information should be provided. The advantage 
to knowing someone's equation before he actually embarks on the interview 
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road is one of reliability. A bootstrapping phenomenon (Dawes, 1971) has 
been observed. Simulated judgments may be better, in the sense of pre- 
dicting some criterion or Implementing the subject's personal values, than 
are actual judgments at any given time. This results because the decision 
maker, at any given moment, lacks the reliability of his equation. 

Finally, the advantage of this procedure is better understanding. 
Focusing on the individual as the unit of research while simultaneously 
maintaining methodological rigor (controlled situation, maintaining large 
N, etc.) makes it possible to achieve a high level of psychological des- 
cription and understanding. 
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BIOLOGICiJ. APPROACHES TOWARD THE PREDICTIW AND 
ENHANCEMENT OF HUMAN PERFORMANCE 



Bernard Rlmland, PhD 



There Is a good deal of overt dlss/itlsfactlon- and, in my opinion, 
it is well deserved--with the rather difimal progress achieved by the 
behavioral «d social sciences during the past several decadea. Personnel 
psychology is no exception. The couin^jnt has been made by a auafcer of 
people, for exan^le, that if one were to average all the validity coeffi- 
cients computed during the 1970's, and compare them with the average of 
the validities obtained during the 1930*8, no significant Improvement 
would be found to h&vs been achieved in that forty year period. 

Selection research is by no means the most backward of the «rea8 to 
which psychologists have addressed thens elves. Much less has been 
achieved in other areas. 



For same time, L have been aware of this problem and wondering what 
can be done. Where have we gone wrong? What ;.s missing? It seems to me 
that e major josslbllity for getting personnel psychology back on the 
ri^t ttv^ck resides in building bridges to biological psychology. Major 
developments have taken place in biological psychology in the past decade 
or two that should be capitalized upon. You have often heard the term 
"overlap." I propose the word "underlap" to characterize our present 
dilemma. Effort is needed to fill in the large gap between what our 
biologically-oriented colleagues have learned and what personnel psycho* 
logists have placed into practice. 

Some of the work at the Navy Personnel Research and Development 
Cenler is devoted to filling this gap. I will describe parts of this 
work, and tell you about some of our related ideas, not yet at the 
research stage, which we hope to be able to investigate in the future. 

Brain Wave Research 

For the past several years our laboratory has been doing colla- 
borative brain-wave research, under Office of Naval Research sponsorship, 
with researchers at the University of California Medical School in San 
Francisco. The project involves getting numerous brain wave measurements 
(evoked responses) from the subjects as they watch a flashing ll^it. They 
are Instructed to signal via a hand-held switch to Indicate whether the 
light is dim or bright. Electrical signals showing multiple aspects of 
functioning are collected from electrodes in contact with the subjects' 
scalps. Response latenc. and amplitude, differences between signals from 
various parts of the brain, and habituation rate are among the large 
nunfcer of measures tape-recorded from each subject. The tapes are then 
sent to the medical school laboratory in San Francisco where they are 
confute r-scored. The scores are then returned to us for further analysis. 
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After the men tested have been in the Navy 18 months, we plan to 
follc^w them up to get Indices of performance of special Interest from the 
personal standpoint, such as grades in training, supervisory ratings, and 
records of disciplinary infractions. 

Por these men a wide range of scores on various paper and pencil 
tests, both operational and experimental are available. Analyses will 
thus pemit evaluation of the brain wave tests against both performance 
criteria and aptitude tests. 

In the past few years the popular press has carried numerous articles 
on the work of John Ertl, of the 'University of Ottawa, who pioneered the 
use of coinputer-averaged evoked re&ponses as a means of testing intelligence. 
He has reported correlations in the .SO's between his brain wave measurea 
and scores on traditional IQ tests. However, others who have tried to,/ 
replicate this work have not been able to do so. We hope that our ^udy 
will cast some much needed ligjht on this problem. 

An extremely interesting aspect of brain wave research that we would 
like to explore involves the rather marked differences between the functions 
of the ri^t and left hemispheres of the brain. Most of the paper and 
pencil tests used involve reasoning, verbal ability, and other high-r 
cognitive analytical tasks, which are primarily the left hemisphere's job. 
Quite possibly the "Low Correlation Syndrome" results, in part, from the 
fact that an important function of the world's work may be performed by the 
right hemisphere, whose activities are much harder to measure with paper 
and pencil tests. The Job of the sonar operator, for example, requires 
coping with several kinds of stimuli at the same time, and weighting each 
stimulus differently as determined by changing circumstances. This appears 
to be the kind of thing ri^t-handed people may be especially good at. At 
least, an effective right hemisphere may be a necessary, if not sufficient, 
prerequisite for a good sonar operator. It is a reasonably straight-fozward 
research task to find if superior sonar operators differ from average or 
below average men in terms of evoked response measures. 

There are other interesting things that can be done with brain waves 
that have isqportant implications for personnel psychology. For example, 
despite the popular press reports whi^h suggest that the main function of 
biofeedback may be to give Nirvana seekers a drugless '•higji," some serious 
research has been conducted which .suggests that feedback of brain signals 
can have some important military-personnel applications. Monitoring, a 
sonar or radar scope can be a very monotonous task. Men begin thinking 
of their next date, or the last one. It is possible to feed brain wave 
input into a switching device so that a drop in attention level rings a 
warning bell intended to alert the n\an, or his supervisor. Similarly, 
students could/ be hooked to such a monitoring device so that brain wave 



activity of a lion-*busines#^ sort could be detected and extinguished. Con- 
ceivably, after a person had a good deal of experience with this kind of 
feedback, he might be able to control his attention, and therefore his 
learning, to a far better degree than before. Why do student^ having simi- 
lar measurefd ability often diffet markedly in their school achievement? 
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"Motivation" is the usual answer. But suppose the "unmotivated" student 
simply was not skilled in deploying his attention effectively? Would 
training him to do so via biofeedback make him a better learner? Maybe* 

The Center has recently acquired terminals lor the riato iV in- 
structional system, for which the computer is situated at the University 
of Illinois. We would like to monitor the brain signals of recruits being 
tested via the Plato terminal. We might learn some interesting things, to 
facilitate both selection and training practices, if we were able to get 
teal time recordings from the right and left hemispheres of the recruiters 
as they fi|:st confronted, then attempted to solve, test items requiring 
verbal, spatial, or both types of abilities. i:) 

Biochemical Testing ^ 

A number of laboratories have reported finding high correlations — 
sometimes in the .60*s— between the level of uric acid in the blood and 
achievement. Such findings have been reported for various groups. In- 
cluding college professors, students, and business executives. Why not 
develop and measure the uric acid level tp supplement the test scores now 
used as admission standards for student selection^ 

Along similar lines, researchers working under Office of Naval 
Research sponsorship have reported finding fascinating relationships 
between an individual's performance on a vigilance task and the level of 
adrenaline in his blood. For this study a catheter was first Inserted 
into each subject's arm so small blood samples could be drawn at periodic 
intervals without the subject's awareness. The subjects were then asked 
to detect occasional flickers in a dim li^t for a three hour period. Most 
of the subjects suffered a severe decline in their vigilance performance, 
missing many flickers as their attention flagged. The level of adrenaline 
in their blood stream varied directly with their accuracy — the bluest 
points in accuracy were associated with the peaks in adrenaline level. 
Interestingly, for a few of the subjects no decrement In vigilance was 

>~-ohsexvad — and correspondingly the blood adrenaline level in these "non- 

decreroenters" also remained high throughout the study! These are findings 
which have clear implications for selection research. 

.ft? 

Light and Behavior 

Let me give you one more example of an area of blopsychology that 
could have important implications for personnel psychology, if personnel 
psychologists were aware of it. John Ott is an expert on time-lapse 
photography—perhaps the expert in time-lapse photography. You have seen 
his work — motion pictures of trees and plants going through a year's cycle 
in a minute or less. In the course of doing photographic work for some of 
the Walt Disney nature films he discovered that he could not grow properly 
colored plants in his greenhouse. He found that the problem was in the 
color of the light the plants were exposed to. This led him to investigate 
the effects of the power spectrum of light — not only its intensity but also 
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its color— first upon plants, then animals. He learned some truly re- 
markable things, which he has reported in several books and in a nunfcer 
of scientific papers. His most recent book. Health and Light s is a 
fascinating and impressive aecount of his findings. Most of us, and I 
specifically include myself, are inclined to regard light very li^itly, 
so to speak, to make sure we have enough of it, then direct our attention 
elsewhere. That is clearly a mistake. Judging from Ott's work. 

Before going on to the behavioral effects of light, let me cite 
a few examples of the extraordinary effects upon measurable biological 
phenomenon in animals of changing the spectral composition of a light 
source. 

When groups of C^H mice, which are highly susceptible to cancer, 
were kept under pink flourescent li^t, spontaneous tumors and other 
bodily defects developed and the animals died at an average age of 7.5 
months. By widening the spectrum under frfiich other groups of CJi mice 
were kept, a progressive increase in life span to an average age of 16.1 
was achieved. >. 

Other studies show the sex ratio of animals bred under artificial 
light can be highly dependent upon the coloration of the light. In 
experiments on goldfish and chinchillas, for exanf>le, the percentage 
of females could be varied from 20 per cent to 80 per cent by changing 
from blue fluorescent to pink fluorescent li^t. 

The li^t variable, then, can obviously have powerful effects on 
hormones and other biochemical systems, but what about effects on 
behavior, especially human behavior? Here we must depart from laboratory 
observations and even anectdotal Information. The information in Ott's 
writings is sufficiently provocative to make human experimentation seem 
very much needed. I am soon going to propose research designed to find 
the effect of adopting Ott's lighting recommendations on the performance 
of Navy personnel. 

Ott notes that most of us nowadays arc starved for ultraviolet 
light energy. We tend to be ultraviolet deficient in the way that our 
bodies can be deficient in a certain vitamin, and for somewhat similar 
reasons. In the cave-man environment and for ages before, while our 
bodies were evolving, almost all of the light we received was natural 
sunlight, which contains a good deal of beneficial ultraviolet radiation. 
Now our daylight is too often filtered through glass, which screens out 
ultraviolet, and our artificial light contains very little energy at the 
ultraviolet frequencies. Is this important? 

Let me read to you a few paragraphs from Health and Light . I think 
you'll find these few paragraphs, excerpted from pages 101 to 106, as 
interesting as I did. 
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VRiile In process of trying to decide how naich 
ultraviolet to give the aniioals, ny wife and I had 
dinner one evening In a restaurant known as "Well of 
the Sea,** In the basement of the Hotel Sherman In 
Chicago. As soon as we entered the restaurant I 
noticed that there were black light ultraviolet lights 
placed throughout the celling. They had been In- 
stalled solely for ornamental purposes, to cause 
designs on the waiters* coats, as well as the menus, 
to fluoresce In the otherwise subdued ll^t. The 
next morning 1 went back to the restaurant with a 
meter to measure the Intensity of the ultraviolet at 
various distances from the celling such as table 
level and the eye level of the waiters as they 
walked directly under the various ll^t fixtures. 

I also wanted to ask the captain of the waiters 
a number of questions. In view of the general con- 
cern, especially at that time, regarding danger of 
over-exposure to ultraviolet, I wondered how long the 
ll^ts had been Installed and whether he had experienced 
an unusually hl^ tum-over among the personnel working 
In the restaurant. I asked him If ^y of his men had 
coiq>lalned of any eye problem, skin cancer, or other 
difficulties, such as sterility, which mi^t be attri- 
butable to working for long perl^ods of time under the 
black light ultraviolet. The captain told me that he 
had essentially the same group of men working for him 
as he had when th^ had opened the restaurant 18 years 
before. He said that the ultraviolet li^ts had been 
in use continually during that time, and that the 
health record of his men had been so consistently 
3xcellent that the manager of the hotel had checked 
into the situation, with medical supervision, to try 
to determine why this particular group of men was 
always on the Job, even during flu epidemics, when 
other departments in the hotel would l^e short-handed 
becatise of eiq>loyees* illness. 

I then talked to the manager of the hotel, who 
told me that these men working In the **Well of the 
Sea** seemed to be a particularly happy group — cour- 
teous and efficient, and all seemed to get along well 
together. He said no explanation bad been found to 
explain this, and that, at the conclusion of the 
study, it was thou^t to be simply a coincidence that 
this particular group of men should be so healthy and 
content. I asked if the men had been given a health 
check-up at the time they were hired. The manager 
explained that this was not customary and that the men 
Just: happened to be at the head of the list when the 
waiters union was called on to staff the restaurant. 

V- 
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On another trip to Florida I gave a lecture to 
an advertising club» and after I had finished vay talk, 
Mr. Richard L. Marsh » manager of radio station WILZ 
near St. Pertersburg, told me of a similar situation. 
He said that some of the staff at the radio station 
had taken it upon themselves to try to brighten up 
their surroundings in both the studios and the control 
rooms by replacing the regular white fluorescent tubes 
with those of a deep pink color. itt>out two months 
later y they began to have personnel problems. For 
example 9 announcers began performing poorly on the air. 
Everyonm became irritable and consistently at odds with 
management decisicms and generally difficult to control. 
^ TWo resignations were received from employees without 

any known reason for their wishing to leave other than 
general dissatisfaction with themselves and the staff. 

Then, one morning one of the men said, "If those 
pink bulbs aren't removed L'll go out oZ my mind." 
That sparked an immediate reaction, and that very day 
all of the pink tubes were removed and replaced with 
the white ti&es. Within a week, as if by a miracle , 
tempers ceased to flare » congeniality and a spirit of 
working together began to redevelop and resignations 
were withdrawn. The alrwork imnroved, with mistakes 
at a minimum. 

Ott also gives many illustrations of the effect on behavior of 
changing the color of the illuminating lights on fish and animals in 
zoosy aquariums y and breeding ranches. 

Men on submarines would make an extremely good group on which to 
try the effects of full spectrum lightings. All we would have to do is 
change the fluorescent tubes on the esqierimental subs and leave the others 
alone. Would the dangerously low reenllstment rate on the subs go up? 

Would there be less Interpersonal frictions? Fewer" lnt4^per«onal pro- 

blems? It would be fun to find out. 

Enough. I hope I've convinced you that even though the biology 
and psychology departments "nay have occupied different buildings on your 
campus 9 they may in real life be less far apart than we thought. 
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VISTAS OF ANALYSIS: 
QUALITATIVE PREDICTION AND DECISION ANALYSIS 



W. J. Moonan, Ph.D. 

Historical Analysis Trends at NPRA; Models and Methods 

Being a statistician, I would not be so presumptive as to' predict- 
future aspects of ''psychology in the seventies". Rather, I would like 
to put in perspective, some historical research , analysis procedures 
carried on b3^ workers in applied psychological research at NPRA frcm 
1932 to the present. This period can be divided quite accurately into 
three analysis eras. The first, from 1952 to 1962, I refer to as the 
Correlation ahd Measurement Era wherein the primary model for analysis 
was the normal bivariate model which provided the theoretical basis for 
various types of correlation coefficients which were used in a myriad 
of research problems experienced by the Bureau of Naval Personnel. In 
the early part of this era, the desk calculator provided the only means 
for computation, whereas in the later stages primitive digital computers 
became available. Perhaps it would not be amiss to state that the^ 
major computer program was that which facilitated the computation of 
mutual product-moment correlation coefficients based on incomplete infor- 
mation for some of less than 40 variables. This program's crowning ac- 
hievement consisted of producing correlation matrices relating the BTB 
and final school grade for each of eight-none Class A Schools whose 
sample sizes were usually less than four hundred « 

The second era, from 1963 to ,1973, I refer to as the Regression 
and Systems Analysis Era. During this time the correlation coefficient 
seemed to dwindle in importance and regression analysis models consti- 
tuted the primary basis for analysis. It was during this time also 
that systems analysis and operations research processes were used for 
the first_time at NPRA to help solve naval personnel problems* By this 
time fairly large and efficient computer systems were available and 
computer programs enabling the computation of regression analyses and 
variable selection procedures were programmed. In this description I 
have omitted many details and divergences from major themes (corre- 

lation and regression) I have alluded to. Distinctive among these ex- 
ceptions is the experimental work carried on by NPRA and NPlltL. I would 
expect that other chroniclers of NPRA would differ in detail from the 
aforementioned exposition. However it would be surprising to have them 
exhibit a categorization differing in spirit from that given above. 

Future Analysis Trends at the NPRDCs Models and Methods 

Judging from observed trends, present technology and apparent re- 
quirements, I would designate the decade from 1973-1983 as the Decision 
Analysis Era. The basis for analysis would be statistical decision 
theory utilizing many different mathematical models (listed below) for 
assisting top management in the Bureau of Nav^l Personnel in solving 
complex personal problems. In this process I believe a new language, 
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founded on decision and systems analysis, called the language of deci- 
sion analysis, will be created for effectively communicating between 
research personnel and the Navy management structure. The types of 
mathematical models to be utilized are: 



I. 


Prediction Theory 


2. 


Probability Theory 


3. 


Mathematical Programming 


4. 


Sequencing 


5. 


Replacement 


6. 


Allocation 


7. 


Inventory 


8. 


Dynamic Programming 


9. 


Queuing 


10. 


Competition 


11. 


Routing 


12. 


Simulation and 


13. 


Game theory. 



The digital computer will continue to be the basic arithmetic tool 
as well as providing display information for real-time management deci- 
sion making. Our task is to learn the language of decision theory and 
to learn how to apply it in practical personnel problems. The key 
elements of the language seem to be the following: 

1. Decision making — To understand that the Intuitive basis for 
actions can be supplemented but not replaced by mathematical 
logic. 

2. Uncertainty — To understand that, uncertainty or knowledge may 
be encoded in the language of probability. 

3. Complexity — To understand how to describe direct and subtle 
relationships. 

4. Dynamics — To understand how the present affects the future. 

5. Economics — To understand the meaning of resources and their 
allocation. 

6. Optimization — To understand how to climb a hill you cannot 
see. 

7. Modeling — To understand how to structure in manipulable form. 

8. Behavioral Science — To understand that a major impediment to 
rationality is not the lack of logical tools but the fear that 
logic mAy expo«$p inconsistencies and weaknesf^ps. 
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Some New Models and Methods of Prediction 



Prediction analysis is the mathematical-statistical process of making 
inferences from what we already know (predictor variables or characters) to 
something which we would like to knoy (criterion variable or category). The 
domain of prediction analysis can be characterized by refering to the follow- 
ing table: 

TABLE 1 

Types of Prediction Analysis 



mltkical 
1'Ki:dictok:: 



CATD^uki CAL 



[Ait r Ko/c-i>uori {1^ 



DEPENDENT VARIABLE 



METRICAL CRITERIA 



REGRESSION ANALYSIS 
Type A 



ANALYSIS OF VARIANCE 
Type B 



CAT}.GORICAL CRl TERIA 



DISCRIMINANT ANALYSIS 
Type C 



ABCD ANALYSIS 
Type D 



p. 5.13)] 



Types A» B and C prediction analysis have well known theoretical and 
computational bases which were thoroughly studied and utilized during NPRA*8 
Regression Era. Type D predictions had not been extensively required 
heretofore but now (circa 1972) research required a solution for an Important 
personnel problem. A hurried but t:horougJi search of the literature showed 
no adequate mathematical, statistical or computer solutions and furthermore 
indicated (Lubln, 1950) that non-trivial approaches were Infeaslble and/or ' 
non-existent. Consequently, the only alternative was to develop a new approach. 
This was accomplished (Moonan 1972) thereby filling in an important quadrant of 
Table 1. 

Subsequently, because the new methodology permitted the use of several 
hundred qualitative predictor variables, a selection technique program, 
CHAROSEL (Bowser, 1973) was developed. The OlAROSEL technique sequentially 
selects qualitative predictor characters leading to better predictions. 

Qualitative Prediction Details 

The fundamental problem of analysis arose because tLe prediction problem 
involved both qualitative criteria and predictors. The qualitative criteria 
were usually "classifications" such as" 

1. Types of achievement 

2. Types of career patterns 

3. Types of training history 

4. Types of training classification 

5. Types of recidivism 

6. Types of drug users. 




The ABCD technique is no't restricted^ as in the discriminant function, 
to two criterion category prediction problems. The predictor variables are 
also qualitative and usually consist of responses of members of samples from 
the populations of interest to background or other questionnaires and/or 
responses to multiple choice tests. I have given the generic term "prediction 
analysis'* to cover both types of analyses conpionly referred to as "regression 
and discrimination" since both effect "predictions"; regression effects pre- 
dictions of metrical criterion variable whereas discriminant analysis effects 
predictions of a categorical criterion. 

The remainder of the first part of this presentation will be concerned 
with the theory, computer program and applications of the ABCD Technique and 
CHAROSEL. The second part of the presentation will discuss a particular 
formulation of decision theory and the application of this structure to an 
important naval personnel problem. 

Decision Theory 

Statistical decision theory was originated about twenty-five years 
ago by Abraham Wald. This theory had its precursors in the work of von 
Neumann (1928) and in the work of Morgenstern and von Neumann (1947) and 
has undergone n^w developments in the work of Savage (1951), Lindley (1965), 
Bellman (1957) and othtrs. What is decision theory? This theory deals with 
the problem of decision making in the face of uncertainty. But since this 
definition is not illuminating, l^t us say that the methods of decision theory 
are universa.^ , covering at least inductive reasoning, the design and interpre- 
tation of scientific experiments and subsume the sciences of statistics and 
operations research. Indeed, to some looked at most generously, decision 
theory represents scientific method and has applications independently and 
jointly in the fields of management and behavioral sciences. 

THE DISCRIMINATION AND PREDICTION PROBLEMS 

These problems are contrasted by the nature of the criterion variable « 
The discrimination method is a procedure for deciding into which of the K o 
categories a new, randomly selected individual, known to belong to one of 
the categories belongs. In the classical discriminant function analysis 
proposed by Fisher (1936 and 1938), K was limited to two and the predictor 
measurements were quantitative. The classical prediction problem is that 
proposed by Fisher and others and exemplified in its most general case by 
the multiple regression model, Johnson (1949). The linear discriminant 
function (LDF) enjoyed wide application in the behavioral and biometric 
science fields, but suffered from the fact that it could be applied only 
to two category problems. This restriction was eliminated by C. R. Rao 
(1952) and other Indian statisticians who generalized the LDF concept by 
introducing new distribution^ procedural and dc^cision theory concepts into 
the classification problem. These techniques have come to be known as 
"Dispersion Analysis". 
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A limitation inherent in all of these solutions was that they applied 
only to predictor characteristics that were measurable and consequently 
could not be used for problems wherein the available basic predictor 
data was qualitative in nature. Esoteric techniques attempting to quantify 
qualitative data have not proven useful. If they were, standard dispersion 
analysis procedures would be more generally utilized. In personnel work 
criteria are frequently categorical in nature and predictor data are most 
generally available from questionnaires administered to samples of the 
populations of interest. Tables 2 illustrfl[tes the kind of qualitative predictor 
data referred to. 

TABLE 2 

An Illustration of Qualitative Personnel Data , 



Active Duty Obligation 



1 » 6 months 4 

2 « 2 years 5 
3-3 years 



Race 



4 years 

5 years 



1 » White 

2 = Negro 

3 Other 



7 




17 years 


2 


m 


22 


8 


m 


18 


3 




23 


9 




19 


4 




24 


0 


b; 


20 


5 




25 


1 


s 


21 


6 


m 


26 






Religion 








1 




Protestant 








2 




Catholic 








3 


a* 


Jewish 








4 


sx 


Other 








5 


SB 


None 









Education 



Service Rejections 



1-6 years or less 
2=7 ^ 
3-8 

4 = 9 

5 = 10 

6 = 11 

7 = High School Graduate 
8=1 year college 

9 = 2 years college 
10 « 3 or more years college 



1 « never rejected- 

2 = USAF ' 

3 » USA 

4 = USCG 

5 « USMC 

6 = USN 

7 « Combination 2 or 3 

8 = All 



Because of the operational requirements, the ABCD Technique theory and program 
necessitatr>d the incorporation of provision for numerous criterion categories 
and very large nuniers of qualitative predictors generated through the use of 
questionnaires • 
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Approach to LDF Problems 



Sir Ronald Fisher (1936) In his maximum likelihood deviation of the 
LDF assumed that predictor variables are measured, available and multi- 
variate normally distributed* The LDF was a two-category problem solution 
and Fisher's Idea was to form a single measurement, y, defined as a linear 
function of the C measurable predictor variables. Thus 

y = Ij^ t^ + I2 t2 + . . . + 1^ tc 

The analysis problem Is to determine . the constants ''li, l2» • * *> ^c 
such that the ratio of the between category variance to the pooled within 
category variance Is maximized* Fisher's contribution was to show how the 
1-vector could be calculated* Classification or "prediction" Is effected 
by funding a value y^, such that If y were less than y^ tha Individual 
belongs to one category, or If y Is greater than y©. the Individual belongs 
to the other category* Fisher did not explicitly utilize the decision table 
concept as a means of evaluating the LDF* 

Approach to Type D Predictions 

For any given Type D prediction problem the criterion categories and 
the predictor characters are specified, together ^±th certain parameters 
required by the program. The population of Interest Is sampled In order to 
collectlvlse a subsampl'^ called, for our purposes, a "training sample"* 
/ The purpose of this sample Is to "train" the program'by estimating the 

probabilities of endorsement lOf each level (alternative) of each predictor 
character for every criterion category* The prediction Is effected by 
using a "cost of mlsclasslf Icatlon" matrix and posterior probabilities 
of categorical membership estimated from the endorsement and Bayes* theorem* 
The actual "prediction"^ Is therefore a decision as to which criterion 
category a sample member Is associated and the decision Is determined by 
Indicating that category associated with the minimum expected cost of 
mlsclasslf Icatlon* 

These decisions are usually computed and assembled Into a decision 
table whose rows represent known categories of membership and whose 
columns represent predicted categories of membership for members of a 
testing subsample* The training and testing subsamples are usually Inde- 
pendent and large enough to accurately estimate endorsement probabilities 
and probabilities of correct and mlsclasslf Icatlon* Ideally, the decision 
table will contain frequencies only In Its principal diagonal. Other 
frequencies are Indicative of poor prediction or mlsclasslflcation,* The 
output of the ABCD technique program lists, for each testing sample member, 
the probabilities of categorical membership as well as providing the overall 
decision table* 

QUALITATIVE PREDICTION: THEORY 

In order to indicate the theory behind the qualitative prediction 
process known as the "ABCD Technique" It is necessary to develop a certain 
amount of notation* Let represent the choice of the ath alternative to 
the c^^ qualitative character made by a representative sample member of a 
testing sample obtained from sampling the population associated the 9k^ 
criterion category* Also, let us represent the vector of all x^ for a 
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sample menfcer by the symbol x. We can also represi^ent the endorseinent ratio 
probabilities estimated from the training sample by the syirbol p(xa[ek) 
We assume that there exist K criterion categories and that the probability 
of a sample member from the k^^ criterion category responding to the c^h 
qualitative character is p(x§|eic) . Assume futhermore that the qualitative 
characters possess statistical independence (we shall comment further on 
this assumption later). With this assumption the total probability of the 
response vector x can be written as 

p(x|ek) « \ p(xS|o.) . 

c»l 

Our interest, however, is not attached to p(x|ei^), but rather to the inverse 
probability p (0^1 X) which can be obtained by using Bayes* theorem (1963) 
further assuming that we know the a priori probability of observing a member 
of the k^" category, p(0j^) . Thus 

PC^klx) ^ P(ei.)p(x|Qi.) . 
k 

I P(0k)p(x|0k) 

K«l 

These K nuinbers are called posterior probabilities of category meid)ership« 
We assume also that our previous analysis has included the specification of a 
K X K matrix called tl\e costs of misclassification matrix, L(i,j), whose 
non-main diagonal elements indicate the loss associated with misclassifying 
a member, known to belong to the i^*^ category, into the jth category. Using 
L and the posterior probabilities we compute the Bayesian decision values 

k 

B(j) « I p(x|Oj) . L(iij) . 
i«l 

We make the decision L(X) « g if B(g) 4B(j), g ^ j, g,j « 1(1)K, meaning 
that we make the decision that the member is a sample from the gth category 
if B(i^) is the minimum of all B(j). The letters ABCD represent the acronym 
"Attribute Bayesian Classification Decision" and because we use the Bayes' 
decision criteria we designate the technique as "Bayesian". Actually, it is 
doubly Bayesian since we also use Bayes* theorem to calculate the posterior 
probabilities. 

The Character Independence Assumption 

The author was reluctant to utilize the character independence assumption 
mentioned above because of his experiences in dealing with qualitative 
variables. Frequently, they are weakly associated and the association is 
usually poorly estimated. However, there seemed to be no tractable means 
of computation if the assumption was not made and the decision to make it 
was reinforced by noting in the statistical literature and comments from 
other mathematical statisticians that "everybody dealing with multiple 
qualitative characters in Bayesian decision theory makes that assumption." 
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Actually, this is no justification but the decision to proceed with It 
turned out to be wise since subsequent applications of the technique, 
whether the data justified It or not, were relatively spectacular. Truth- 
fully, I ^it uncomfortable about It but have found no way to avoid It and 
still provide an effective means for making qualitative predictions. 

IMPLEMENTATION 

The ABCD Computer Program 

The ABCD technique was programmed as a computer program for the 
NPTRL IBM 1130 system Iti 1972. The documentation for this program Is 
specified In reference Moonan (1972). The program was skillfully coded 
In FORTRAN II by Mrs. Margaret Covher using analysis provided by Hoonan, 
The program utilizes an Input form and requires Input consisting of: 

(a) The number of categories and p(9i^). 

(b) A cost of mlsclasslf Icatlon matrix. 

(c) Endorsement ratio probabilities. 

(d) Input forms. 

(e) Data for the testing sample. 

The output is a decision classification for each member of the testing 
sample and an overall decision table indicating the probabilities of all 
types of correct and incorrect classification of members of the testing 
sample. An overall measure of the total costs of mlsclasslf Icatlon are 
provided, and, at option cards containing the composite probabilities 
p(X|9|^) for each member of the testing sample. 

Applications 

The ABCD technique computer program has been applied to various types 
of problems among which are the identification or classification of: 

(a) Undersea targets. 

(b) Drug abusers. 

(c) Naval personnel recommended or not recommended for reenllstment • 

In the reenlistment example, the program made only three classification errors 
for a testing sample of three hundred twenty-four men utilizing information 
from a recruit temperament survey. 

The program was also applied to the classical problem of discrimination 
first presented by Fisher (1936). This problem is known as the "Iris Data" 
problem for which three quantitative variables are available for classifying 
iris plants into one of three types of iris: 

(1) Vlrginica c 

(2) Setosa 

(3) Versicolor 

For this problem the quantitative variables were arbitrarily qualified. The 
results of this application are shoim below in Table 3. 
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TABLE 3 



Frequencies of Classification of the Iris Data 



Assigned Classification 





Vir 


Set 


Ver 


Total 


Vir 


33 


0 


0 


33 


True 










Classification Sec 


1 


29 


3 


33 


Ver 


0 


1 


3: 


33 


Total 


34 


30 


35 


99 



For this application, the percent accuracy is about Over a vide 

variety of applications the percent classification accuracy has remained 
surprisingly high even when both training and testing samples were com- 
pletely independent. The program has been shown to be operational, easy 
to use and relatively efficient. It has been surprisingly popular, being 
applied for analysis in several different types of research projects. 

Prediction Types C and C & D 

The linear discriminant function of Fisher suffers from limitations 
in its classical form. First it does not minimize costs of mlsclassification 
and usual forms of itf: computer program do not produce a decision table or 
decisions of categorical membership for each object in the testing sanqple. 
Consequently, a new type C discriminant technique was developed by Moonan 
(1972). This technique is called PGM: Probability of Group Membership, and 
was devised to overcome the aforementioned objections to the LDF. The PGM 
program vork& "similarly to the ABCD program. However, it uses quantitative 
rather than qu litative predictors. The mathematical approach makes use pf 
a subroutine called DENS, Moonan and Covher (1972), which computes, for each 
object in the testing sample, a multivariate normal probability density func- 
tion for each category of the criterion variable.. These density functions, 
when multiplied by the mathematical differential dx, represent probabilities 
and therefore can be utilized to calculate posterior probabilities in the 
same manner as ABCD. The differential elements divide out in this process, 
therefore their use is purely formal. As indicated in Moonan (1973), the 
analysis of covariance represents a solution to a prediction problem of type 
AliB. Correspondingly, a new procedure, programmed as MIX, Moonan (1973), 
contributes to the solution of tyre C&D prediction problems, i.e., problems 
where it is desired to predict categorical membership from knowledge of both 
quantitative and qualitative predictor variables. 

Both the PGM and MIX computer progtdms and their applications are 
described in Moonan (1973). 
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SELECTION PROBLEMS FOR QUALITATIVE PREDICTIONS 

Soon after the ABCD technique program was operational, it became 
obvious that some procedure was required to select a subset of the quali- 
tative predictor characters. This was necessary because the program 
accommodated several hundred predictors and such sets were realized for 
some applications. Obviously, it was desired to reduce the predictor set 
to a smaller number of effective predictors if the quality of prediction 
was not detrimentally affected. Table 4 shows various other types of 
prediction techniques, each has its own individual variable selection 
technique. Accordingly it was decided to devise a selection technique for 
Type D predictions and to call the technique by the acronym CHAROSEL, 
meaning selection of characters. The analysis for the program was devised 
Jby Moonan with contributions and expert computer programming made by 
Samuel E. Bowser. 

The CHAROSEL Computer Program 

The character selection feature invoked by CHAROSEL is obtained by 
computing decision tables and associative objective functions for each 
predictor character available. That •character with minimum objective 
function is the first character selected. In the second stage, CHAROSEL 
combines the first selected character together with each other available 
predictor and selects the pair which produces the decision table minimum 
objective function. That predictor chosen in combination with the first 
selected character is then designated as the second selected character. 
This process is repeated sequentially until all available predictor 
characters are exhausted or until the program terminates because of data 
processing constraints. 

An obvious objective function for the decision tables is an index 
measuring the degree to which the decision t>ables contain frequencies only 
in their principal diagonal. Such an index, utilizing information theory 
and ingenuity was devised by Bowser, and the optimal value of the objective 
function is unity. 

The input to the program is similar to that required by the ABCD 
Technique program. However, upon request, CHAROSEL will compute the 
endorsement ratio tables from a training saiiq)le. The outputs are: 

(1) A decision table for e<xzh character selected. 

(2) Objective function values, objective function changes, 

percent correct decisions anS change in percent of 
correct decisions. 

(3) Characters are listed in rank order as they are selected. 

Endorsement ratios are punched and listed if they are calculated by the 
program. The program is written in IBM 360/65 FORTRAN G and utilizes 
375K slow core of an IBM 360/65. There are a few minor restrictions pro- 
vided by Bowser (1973). 
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Applications of CHAROSEL 

The CHAROSEL technique has not been previously available but has wide 
applicability for research and other problems concerned with predicting 
categorical menbership from knowledge of other categorical information. 
Some recently proposed applications include: 

(1) The identification of potential hijackers of coms^rcial 

aircraft • 

(2) The identification of autistic children. 

(3) The identification of stroke victims nho can or cannot 

be relieved of paralysis by means of a cerebral operation. 

The program is applicable to many problems of medical prognoses and dia- 
noses. At NPTRL, CHAROSEL has been utilized for several naval personnel 
project analyses. Table 5 provides a summary of these applications. If 
allowed, CHAROSEL will select all available characters sequentially. In 
this process, an unusual phenomenon occurs, in that as the number of 
characters increases, the objective functioti value usually decreases to a 
point and then increases sligihtly showing that the addition of information 
does not always increase qualitative prediction. A similar phenomena was 
noted in an item selection procedure called Sequin, Moonan and Pooch (1966) 
and in regression analyses. The CHAROSEL output also assists as a "theory 
generator'' in that the most discriminating characters are selected early 
and may be collectively me sobers of the same class of variables. 

Options to Assist Applications Analysis 

^ ' - . 

The research worker who uses CHAROSEL has considerable freedom with 
regard to the type of procedure he wishes to utilize with this program. 
Experience has shown that such freedom is both desirable and necessary for 
programs intended to be utilized with a wide variety of applications and 
data sets. The options available are described as follows: 

1. The endorsement ratios, p(Xat^)» either be supplied to the program 
by the user or the program will calculate them from sample data. This 
implies that the user need not dichotomize his data into both "training" 
and "testing" samples, but rather, may treat his data as one conglomerate 
sample, partitioned only with respect to criterion categories. 

2. A limit may be given for the maximum number of variables which are 
"missing" on a sample member. For example, if the user specifies 5 for this 
parameter, the program will ignore any saople member with 5 or more missing 
variables in his record set. Missing data are allowed for by the program 
by utilizing one of the a -alternative levels as the missing data level. 

3* Certain designated predictor variables may be forced to be utilized 
initially in the variable selection process. 
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A. If desired, the user may instigate a cross-- validation analysis by 
using variables selected by CHAROSEL and then using the ABCD Technique 
program with another sample. 
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5* The program utilizes an input form and a training or conglomerate 
sample; data be entered either on cards or magnetic tape. 



CHAROSEL Restrictions 

The program is not coiqpletely amorphous but does impose the restrictions 
noted as follows: 

1. The training or conglomerate sample size is required to be less 
than or equal to 500 menbers, 

2. The nufldier of criterion categories must be less than or equal to 10. 

3* The number of a-altemative levels for each predictor character must 
be less than or equal to 10 (including the missing data level) • ' j 

< 

4. The nunfcer of predictor characters is limited by IBM 360/65 core 
size* The present operational program is restricted to a iNiyim^im of 200 
predictor characters. 

5. The present version of the program is operational only on an IBM 360/65 
computer system and uses a core size of 375 K bytes. 

6. Although the program has been utilized successfully for several 
applications, in the opinion of the author and the programmer, it is not 
sufficiently shaken down to the point whereby it could be utilized, without 
concern, for any data set. Consequently, the program is considered semi- 
proprietary. Prospective LOD users may arrange for program execution through 

(d) Coomumuing Officer, NPRDC, 

(b) The Personnel Utilization Directorate, and 

(c) Director, Computer Applications Department. Other 
potential users should contact the author. 

SUMMARY OF QUALITATIVE PREDICTION PRESENTATION 

Three eras of analysis were identified during the history of NPRA, NPTRL 
and MPRDC. These eras were the correlation, regression and decision 
analysis eras. The latter, has only recent birth and is expected to continue 
for the next decade. During this initiation, it was recognized that statisti- 
cal theory, local analysis and computer programs were unavailable for solving 
a certain class of prediction problem (Type D). An efficient solution to this 
type of problem is essential since this problem class is expected to occur, 
and indeed already has occurred, in naval personnel research activities. The 
solution to this problem was developed by the author in 1972 and subsequently 
realized that a character selection procedure was required to effectively 
utilize ABCD. Consequently, another computer program, "CHAROSEL,** was 
devised by Moonan and Bowser, for character selection problems. Both programs 
are described in detail in this report. 
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PART B. DECISION PROCEDURES 



Geniuses of Decision 

Many men have made significant contributions to scientific decision 
making in the twentieth century. Among these are a few standing head and 
shoulders above the rest with respect to their contribution. One of these, 
John von Neumann^ a Princeton mathenuticlan, made an early contribution 
(1928) formulating the basis fdr the "theory of games" which formed a basis 
for future developments in decision theory, von Neumann axso made contri- 
butions toward the development of modem digital coB^uters and, in fact, 
was honored by having the first Rand Corporation computer which he designed, 
named in his honor (Johnniac). The next stage of the development was taken 
by Abraham Wald, a Rumanian immigrant and ultimately Professor of Mathema-- 
tical Statistics at Columbia University. Wald developed the subject of 
statistical decision theory (1950) which formed the mathematical basis for 
most subsequent developments in decision analysis. Wald's contribution was 
to place, on a rigorous basis, a useful theory of processes for making 
decisions in the face of uncertainty about the future, thereby relieving 
mankind of the obligation (real or imagined) of consulting soothsayers, 
sibyls, cards, etc., for advice for good decision making. Interestingly 
enough, because decision making is still complex, there still exists a need 
for auxilliary help in spite of the newly-created decision tools. For ex- 
ample, the Air Force has the Rand Corporation, and other more private agen- 
cies such as Mathematica, RAC, Systems Development Corporation, and others 
stand by to assist their clients in the decision making process, von 
Neumann collaborated with the economist Morganstem (1947) in writing one 
of the most significant books of the modern technological era. This book, 
together with Wald's (1950) Statistical Decision Functions , will undoubtedly 
rank among the major scientific contributions of the first half of the 
twentieth century. It would be remiss not to include the name of Richard 
Bellman among our list of decision geniuses. Almost single handedly he 
developed the theory of dynamic programming which is a theory of making 
multi-stage decisions. Futhermore he has contributed, by 1961^ 15 signi- 
ficant books and over 400 mathematical research papers — a truly prodigous 
effort. Dynamic programming in itself is a major contribution since it 
provides solutions to decision problems otherwise impossible or extremely 
difficult to solve. 

Decision Making, Decision Theory and Decision Analysis 

For hundreds of thousands of years, mankind has been making decisions 
without scientific assistance. We all realize, as history illustrates, that 
the quality of these decisions differ considerably. In recent years it 
has been realized that decision making may be described by a six-step pro- 
cedure of the following form: 
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1. A point in time, called the Decision Point exists when the 
decision maker experiences a need for making a decision. 

2. Then, the process of Exploration occurs when the decision maker 
considers and contemplates about all possible alternative actions open to 
him at the decision point, and acquires necessary facts and information. 

3. During the process of Evaluation , he makes clear to himself the 
implications, values, utility, advantages and disadvantages involved in the 
alternative actions. 

4. A tentative selection of an alternative is made during the Choice 
phase. 

5. During Clarification the decision maker examines and reflects upon 
tUe tentative selected action to ascertain the wisdom of making it. 

6. The final step occurs when Action is taken. We note that a 
decision is not a mental coimnitment to follow a course of action but rather 
the actual pursuit of that course of action. 

It ?s enc^uragiug and interesting to note that decision making and 
decision concepts have been and are being developed and applied to voca- 
tional decision making problems of high school and college students. In 
fact one of our conference speakers. Professor David Tiedeman, has been 
an early ^nd long standing contributor to this effort. Some of this 
research has resulted in guides, computer programs, or manuals to be followed 
by high school students in planning their educational careers. The following 
references are indicative of their attempts. [Katz, N. B. , (1971); Miller 
and Gelatt, (1971).] 

These aspects. Exploration, Evaluation, Choice, Clarification and 
Action are symbolized and formally interrelated with mathematics in statisti- 
cal decision theoty. 

The structure of decision theory has as many interpretations as there 
are interpreters. The following specification seems, to the author, a 
sufficiently simple and reasonable one. Our intention is to first char- 
acterize this structure and then to apply it to a naval personnel problem. 
The structure may be characterized as follows: 

1. Specification oi the Feature of Uncertainty . This includes the 
identification of the possible States of Nature (0). With respect to any 
decision problem the set of "States of Nature" is assumed to form a mutually 
exclusive and exhaustive listing of those aspects of nature which are rele- 
vant to the particular choice problem and about which the decision maker 
is uncertain. Although this characterization is quite vague, there is often 
a natural enumeration of the possible pertinent states of the world in 
particular context. We assume there is a "true" state of the world which 
is unknown to the decision maker at the time of choice or which is operating 
to produce results of observed events. 
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2. Determine information, X which is available about 0. X is called 
the Record Set which may be obtained by observation, questionnaire or 
experiment* 

3. Relate information, X, to that which is uncertain, 0. This is 
usually done in terms of probabilities or probability density functions, 
p(X|0). 

4. Specify the possible courses of action (a). 

5. Determine the payoff or loss table, U = u(0, a), associating a 
payoff or loss with each possible action with each possible 0. 

6. Relate the information available, X, to the posssible actions, 
thereby specifying each X to an action: P X U = S = s(X,a). This process 
specifies possible strategies or policies (tt) and is called "selecting 

a possible decision procedure." 

7. Evaluate the "worths " of each policy including their admissibility 
and thereby look for uniformly best policies. 

8. Select a decision criterion for choosing a single admissible * 
policy. 

9. Apply that criterion to select a policy for action. 

10. Carry out the policy selected, thereby making the decision required. 

Decision analysis is a logical procedure for balancing the factors 
that influence a decision. The procedure incorporates uncertainties, values 
and preferences in a structure that models a decision. Thus, the aspects 
of decision analysis are more formal than decision making but constitute 
a structure of decision theory somewhat different from that presented above. 
This decision analysis procedure is advocated by Howard (1966) and he pro- 
vides the following outline of the process. 



I. Deterministic phase 

1. Define the decision 

2. Identify the alternative^ 

3. Assign values to outcomes 

4. Select state variables 

5. Establish relationship at stat^ variables \ 

6. Specify time preference analysis: 

(a) Determine dominance to eliminate alternatives 

(b) Measure sensitivity to identify crucial state 

variables . ' 
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II. Probabilistic phase 

1. Encode uncertainty on crucial state variables 
Analysis: Develop a profit lottery 

2. Encode risk preference 

Analysis: Select best alternative • 

338 3^9 . ''■^•^^ 



> 



III. Post-mortem phase 



Analysis: (aX Determine value of eliminating uncertainty 
In crucial state variables 

(b) Develop most economical Information-gathering 
program 

To set these three approaches In perspective It seems Inappropriate 
to use "Importance" of a problem as the criterion for using decision 
making, decision theory or decision analysis procedures as the basis for 
analysis. However, an aspect called "complexity" seems more appropriate. 
We may, therefore, relegate our most sliiq)le problems to the procedures of 
decision making and our more complex problems to either decision theory 
or decision analyses procedures, the distinction perhaps being based upon 
the thoroughness by which the analysis should be completed. 

Illustration; Personnel Policy Making with Decision Theory ^ 

The problem used here to Illustrate the procedures of decision theory 
is a real problem faced by the Bureau of Naval Personnel. The official 
title of the project is "Early Identification of Potential Drug Abusers" 
whose short working title is ID Drug Abuse (Project number 521.005.01.09o) . 
As specified by the Project Director, Target #4, Goal #11 is to "develop 
predictor scales for use in the selection, identification of good rehabili- 
tation risks and in the evaluation of preventive drug abuse programs." The 
analysis approach to the scale development is intended to be achieved through 
the use of the ABCD Technique and CHAROSEL using available record sets from 
abstainers and two types of drug abusers. For our illustrative purposes 
we shall restate the project objective to be that of "to determine the 
'optimal' personnel policy for handling identified abstainers and drug 
abusers among enlisted naval personnel." We set up this "straw man" only 
to illustrate the effectiveness of decision theory for creating personnel 
policies and to promote such research capability. 

The Problem to be Considered 

The problem to be considered is that of finding an "optimal" personnel 
policy. By the word "optimal" we mean here the selection of one of the 
admissible policies by means of an auxllllary decision criterion. By the 
term "policy" we mean the specification of an action for each possible value, 
in the record set Xor a reduced record set. 

T he Uncertainty Feature 

Through the use of the ABCD Technique, all the 139 characters in the 
record set (consisting of biographical and opinion data information) are 
reduced to a single decision variable, X, which takes on three values; 
a 1, X2 « 2 and X3 « 3 ^ These numbers are used to decide if a 
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member is one of three s*:ates of nature (0). The states are as follows: 

01 = Abstainers from drug involvement 

02 = Minor drug involvement termed "Recreational" 

03 = Hard drug involvement* 

The feature of uncertainty is that we are uncertain as to whether or not 
the X variable correctly identifies the classification of the member. 

The Available Inf oration 

The available^ information about 0 is summarized into a single variable 
called X which can take one of three values. This variable is in fact a 
summarization of data from a member which consists of 139 biographical 
items and opinion responses. A. biographical item might merely say * 

Which of the following alternatives characterizes your 
homelife situation during early childhood? 

1. Lived with both natural mother and natural father. 

2. Lived with natural mother only. 

3. Lived with natural father only. 

4. Lived in foster home. 

5. Other. 



An opinion item might be 



Marijuana is addictive. 

1 . Agree 

2. Disagree 
3. 

The information, X, specifies a decision, made by the ABCD Technique, as 
to the classification of the member whose data was used for the record set 
in the analysis. 



The Uncertainty - Information Relation 

From our previous studies, we determine probabilities associating 
the possible states of nature, 0, with the record set, X. This information 
has been obtained from a testing sample completely independent of a training 
sample used to estimate the endorsement ratios p(Xg|0). The probabilities 
are summarized in Table- 3. 



TABLE 6 

Relatioo^hip of Record Set and Uncertainty Feature 
(Probabilities) 
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Some Feasible Personnel Actions 



Wl\en considering what course of action to take with a member identi- 
fied as one of the O's an administrator has a wide variety of actions avail- 
able to him. For illustrative purposes we have restricted this list to 8 
actions specified in Table 7, These actions cover those which first occur 
to the mi! d and include the possibility of taking no action or utilizing a 
composite action composed of simple actions. 

». 

TA13LL: 7 

Action Sut for Drug Involvement Problem 



Action 

/ 1 


1 Acronym 


Description 


d \ 1 

i 1 


1 ' NULL 

roue 


liXf^is no aCt-ion* 

Enter man in druvj education 
program. 




TKAM 


Transfer man to another 
non- critical billot. 


a,, 


TULk 


Enter man in medical-psychological 
therapy program. 




PUNI 


Threaten or actually punish man 
with di sci^lig^ry measures. 




\)lhC 


Discharge man from naval service. 






Compobito policy combining actions 
a2 and ai^. 




Hi:iiAJi 


Comxjoriite policy combining actions 
a/^ and a^. 
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The Payoff Matrix 



In this problem, as in other decision theory problems, there is a 
requirement to specify a payoff table which quantifies the value or utility 
of each possible action for each state of nature. This quantification is 
a personal one on the part of the decision maker and is sometimes quite 
difficult. Various schemes for this type of problem ^have been proposed, 
including those of von Neumann and Morganstem (1947), Hosteller and Nogee 
(1951), Howard (1967), and Curtis (1967). The author has also developed 
a simplified procedure described in Moonan (1973). That payoff table, 
devised by the project director and staff, appears as Table 8. 

TABLE 8 

Drug Involvement Payoff Table 



Action 


01 


02 


03 


• NULL 


300 


300 


120 


EDUC 


395 


390 


315 


IRAN 


195 


220 


380 


THER 


335 


330 


320 


PUCI 


175 


220 


275 


DISC 


120 


100 


250 


REOR 


190 


270 


310 


REHAB 


130 


200 


390 



Some Personnel Policies 

Because we have three possible values of the decision variable and 
8 possible actions (A), we theoretically have available to us 8^ « 512 
feasible personnel policies. Of course, we shall not consider all of 
these here but shall merely specify an arbitrary number, which we take to 
be 10, as indicated in Table 9, 

These 10 policies represent a reasonable consideration of the total 
512 policies available. 

Policy Worths 

It ±F possible, using Tables 6 and 8 to assess the "worth'' of a policy, 
11, when the state of nature is Oj^. The formula for the worth xs provided by 
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W(7r, 0.^) « Z U {a(X), 0J,} p(X|0j^) . 

For example, 

W(tt1, 01) « 395 (.890) + 395(.066) + 195(.044) - 386.2 . 
This, and other worths are indicated in Table 9. 

TABLE 9 

Some Possible Decision Policies and Their Worths 



Policy Actions 



Policy Worth 
01 02 03 



Admissible 
Policies 



B(7r,a) 



^1 


a 






386.2 


371.9 


368.4 


2 














a 


#a 




301.6 


361.8 


355.7 


1 


2 


3 










a 

2 


#a 

2 


#a 

2 


395.0 


390.0 


315.0 




a 

1 


la 

1 


#a 

b 


292.5 


289,2 


341.7 




a 


#a 


#a 


301.4 


367.2 


298.2 




1 


2 


7 










a 

1 


#a 


#a 

G 


298.3 


348.9 


249.0 


"7 


a 




#a 


392.4 


383.5 


315.1 


2 




^ 










a 


#a 


la 


185.4 


209. ft 


290.4 


7 


& 


S 








11 


a 

ii 


la 

5 


#a 

7 


318.1 


237.4 


306.7 


^10 




la 


#a 


187,8 


202.2 


389.4 


i 


B 


6 









379.28 



379.30 



376.2 



227.8 



Admissible and Inadmissible Pollclec 

Inspection of Table 9 shows thai we can dismiss, as unsound, some of 
the 10 policies. For example, policy has. worths which are each smaller 
than the corresponding worths of policy „!. Consequently, it would 
therefore clearly be more valuable to adopt policy n^^ rather than pal±cy 
it2 for any possible state of nature. We use the term inadmissible to 
describe a policy, n, which is such that, for soide other policy n* 

W(n, 0.) <_ W(n',0,)' 
W(n, ©n < W(n',0p' 
W(n, 03) <^ VKir'.dp - , * 

with strict inequality for at least one.of-Oij 02 or ©3. As noted in 
Table 9 policies ny, 115, ng, ng and, are ^^adiolsslble whereas ve have 
4 admissible policies; ^i, n3, and n-ia. ' Consequently, we have no 
unifo.rmly best policy and in order to select an "optimal" policy, we either 
O must utilize, additional information ot appeal to i supplementary decision 
' ERIC criterion. . V ' 
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good classification accuracy, a computer can be prograaned to list all 
possible response patterns to the 5 or 6 characters and indicate to field 
administrators which course of action should be followed for each response 
pattern. 

SUMMARY QF0ECISION ANALYSIS PRESENTATION 

This section began by noting the contributions of von Neujuum, Wald, 
and Bellman to modem decision analysis and by contrasting the structures 
of decision making, decision theory and decision ^Aalysis, the latter 
expected to be the primary procedural mudel for administrative decision 
making associated with K?RDC personnel research during the next decade. 

A particular naval personnel problem was selected to illustrate the 
structure of decision theory and to provide an educative exasfile for general 
consideration. It is expected, however, that the more useful model will be 
the decision analysis model, although they are highly related. The intent 
of the analysis was to specify a "personnel policy" which could be utilized 
routinely for handling naval enlisted personnel identified as belonging 
to one of three stat-.es of drug involvement by a technique developed by 
the author. One concomitant benefit derived from the application of either 
decision theory or analysis models is that their technical terminology 
provides a convenient and effective language for conveying the objectives 
of naval management quickly and effectively to personnel research workers. 
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RECENT AND PROJECTED DEVELOPMENTS 
IN 

ABILITY TESTING BY COMPUTER 
James R« McBride 

David J. Weiss 



A wide variety of conventional paper--and-t>encll ability tests Is 
employed In milltaiy and Industrial settings to provide infomatlon 
needed for personnel selection and placeisent decisions* Even ttte best 
test or battery represents a conpromlse to some degree. Long tests » or 
batteries of shorter tests, pro^rlde fairly precise Infomatlon at the 
expense of testing time. Shorter tests require less time, naturally » 
but provide relatively Imprecise Information about persons. 

Errors of measurement or of classification are potential sources 
of waste of looney or loss of organizational effectiveness; this state- 
ment's truth value probably Increases as a function of the size of the 
organization, and ha^ obvious Implications for an organization the size 
of the Navy. The armed services—or any large industry — have a vested 
interest in improved personnel testing from an economic point of view. 
Social considerations today require that Interest to be extended to a 
social viewpoint as well; people, as well as the organization, need to 
be considered. In the past, paper-and-pendl stanJairdized group tests 
have served employing organizations fairly well, from the dollar-and-dlmes 
viewpoint — bnt Improvement would certainly not be unwelcome. Today, as 
in the past, such tests"' are under scrutiny by persons seeking to upgrade 
their "fairness" to individuals, and to minority groups within the 
society. Criticism from these quarters is not often psychometrically or 
statistically sophisticated — neither is it always unfounded — but its 
sheer volume may be compelling. 

Any consideration of how standardized tests may be improved**- from 
either the psychometric or the social viewpoint — ougjtit to consider their 
general limitations. One weakness o£ such tests is the requirement for 
a human aaministrator: humans vary; administrator variability along 
certain dimensions has been suggested to have differential effects on 
examinee performance (Handler & Sarason, 1952). Another problem is the 
answer sheet, which has been shown to affect performance in several ways^ 
differentially for different groups (Gordon, 1958; Hayward, 1967; Clark, 
1968; Nitardy, Peterson, and Weiss, 1969). The sequence of presentation 
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of test items in terms of the difficulties of the items, and the 
presence of time limits have both been found to affect test performance 
differentially across anxiety levels, and thus probably across ability 
(Klosner & Gellman, 1971; Sax & Cromack, 1966; MacNichol, 1956). 

The strength of the standardized paper-and-pencil test lies In Its 
constancy: it may be thought of as a set of highly standardized stimuli 
to which the examinee must respond. In that strength resides a limita- 
tion also. To the extent that the level of difficulty of a test is 
inappropriate for the ability levels of some examinees, the quality of the 
resulting measurements must be questioned. Boredom, fatigue, and guessing 
effects are all hjrpothesized to be related to the degree to which test 
difficulty deviates from individual ability (Nunnally, 1967). Several 
researchers have concluded that the precision of measuren^nt is not inde- 
pendent of score level (Baker, 1964; Lord, 1957, 1959, 1970); but precision 
is dependent, at least fn part, on the true ability level of the examinee 
relative to the ability level of the test (Lord, 1970, 1971a, b, c, d) . 
Furthermore, standardized tests are generally constructed to yield a 
specified distribution of scores within the standardization group. Such 
tests may not be sensitive to the distribution of the underlying ability 
in other populations, or may have their utility restricted by constructing 
them to yield, say, a normal distribution. 

An adaptive test—a test that tailors itself to the ability of the 
examinee, which does not try his patience with too many easy items, nor 
his imagination with too many overly difficult ones, nor his stamina with 
just plain too many items—ought to be fairer to the individual and should 
yield more accurate measurement of abilities which deviate from the mean 
(Lord, 1970, 1971a, b, c, d). The state of the art in coiiq)uter science 
today permits such a test to be administered by a computer. Computer 
administration offers all the advantage of adaptive testing, can eliminate 
such sources of error as administrator variables, answer sheets, and time 
limits, and yet retains the standardized stimulus and objective scoring of 
conventional tes ts . 

During the remainder of ray discussion this morning, I will present 
to you five different strategies for adapting the test to the individual. 
I will consider y rather briefly, the rationale, advantages and weaknesses 
of each, and the research which has been done on each, then go on to 
describe briefly the program of computerized testing research being con- 
ducted under ONR support at Minnesota. 

Strategies of Adaptive Testing 

The adaptive testing strategies with which our research is concerned 
can be broken down into five general categories. Within each category is 
a very wide latitude for variations on the general theme. The five, as we 
have named them, are: 
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1. two-stage tests 

2. flexilevel tests 



pyramidal models 

4. Bayesian strategies 

5. the stratified test 

What distinguishes one from another is the logic by which subsequent 
test items are selected for presentation to a testee. 

TVo-stage * 

• 

The simplest adaptive testing strategy is the two*stage model. 
Essentially this consists of two sub-tests to be administered to any 
testee. On the basis of his score on the first test, the examinee is 
classified roughly as to his ability level. Following classification 
he is administered a second test, this one appropriate to the general 
level of ability at which ne has been classified. Figure 1 schemati- 
cally illustrates a two-stage testing strategy. Stage 1 is a 10-item 
routing test* Stage 2 has four "measurement" tests, each appropriate 
to a different level of ability. A score of 0, 1, 2 or 3 on stage 1 
results in being administered the easiest measurement test. An 8, 9, 
or 10 on the stage 1 test routes the testee to the most difficult test, 
while scores of 4, 5, 6, or 7 route to the measurement tests of inter- 
mediate difficulty. It should be noted here that the examinee does not 
observe this routing process. Under computer administration it is done 
automatically, with no discernible interval between stages. In the 
case illustrated here, forty Itetas are administered sequentially to any 
testee as though they were one test. 

The routing test may be of any desired length, of course; nor is 
there any arbitrary restriction as to the nunl)er of levels of measure- 
ment tests. Practical considerations provide the only constraints. 

The first reported study of two-stage testing was that of Angof f 
and Ifuddleston in 1958. While Angof f and Huddleston did not actually 
route testees, their design was such that the effects of routing could 
be studied as if it actually occurred. They used 40 and 30 item verbal 
and mathematical routing tests^ to route to one of only two slightly 
shorter narrow-range measurement tests. In other words in two different 
ability domains, they classified examinees as high or low, and administered 
the appropriate level of measurement test. They compared their results 
with conventional "broad range" ability tests, and found the narrow 
range tests to be more reliable for the appropriate level groups than were 
the broad range tests. They also found slightly higher validities for 
the narrow-range tests than for the broad range tests, using college GPA 
as a criterion. 



V-3.4 



352 3^? 



Clearyt Linn and Rock» in a series of related papers » reported 
the result^ of some "real data** simulations of four different tvo-stage 
strategies. They used the responses of 4885 students to the 190 verbal 
items of the SCAT and STEP tests; these they analyzed as if each of the 
four adaptive strategies had been used^ employing subgroups of the same 
items* Results were reported in terms of correlations with scores on the 
parent test (Cleary, Linn and Rock, 1968 a» b) and in terms of correla- 
tions with an external criterion (Linn, Rock and Cleary, 1969) — scores 
on two well-established conventional tests taken a year later. Without 
going into detail on the four strategies, let me summarize some results 
of particular interest here. One finding was that the much shotter two- 
stage test correlated highly enough with total score on the parent test 
to suggest that drastic reductions in test length could be made with 
little or no loss of accuracy of measurement (Clery, Linn, and Rock, 1968b). 
To achieve the same accuracy as their best strategy, a standard test would 
require a minimum of 35% more items. The Linn group's validity studies 
against the external criterion were even more favorable to the two-stage 
procedures (Linn, Rock, and Cleary, 1969). In general these studies by 
Cleary, Linn & Rock agree with the results of Angoff and Huddles t<m's 
study. The adaptive procedures appeared to result in higher reliabilities, 
higher correlations with parent tests, and higher validities against 
external criteria than conventional tests of the se*ne length. 

A theoretical study by Frederic Lord (1971d) of **over 200 two-stage 
testing procedures** produced the findings, under rather rigorous formal 
assumptions, that the best two-stage procedure provides almost as much 
"information** as a standard peaked test does at the mean ability level, 
and that as ability deviates from the mean the two-stage procedures yield 
better measurement, with the advantage increasing with the aiMOunt of 
deviation. 

One problem unique to the two-stage strategies is that of mis-routing, 
or errors of classification. Both Angoff and Huddlestcm, and Linn et al . , 
experienced about 20% misclassification by the routing tesCs. 

Multi-stage Fixed Branching Models 

Two-stage tests are conceptually the 8i:!q)le&t adaptive tests. One 
way of looking at them is as a two-stage fixed branching procedure. 
Slightly more complex in structure are what may be called the multi-stage 
fixed branching strategies, two of which I shall discuss: the flexllevel 
design and the pyramidal, or tre^structure designs. 

Flexile vel tests 

I have already mentioned that pne potential benefit of adaptive tests 
is reduction in teap length. The flexilevel test, developed by Frederic 
Lord of Educational Testing Service (1971a) essentially uses a fixed 
branching procedure and a fixec^ number of .items to estimate the examinee's 
score on a test consisting of double the number of items he hks encountered. 
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Figure 2 illustrat«-s the construction of a flexilevel test in which each 
examinee will answer exactly eight items. The test is composed of fifteen 
Items arranged in order of difficulty. Item 1 is the easiest item in the 

^5*" ^ alight: 7 more difficult, and so on up to item 15, the most ' 
difficult item. Each item is more difficult than the one preceding it by 
some fixed increment of difficulty, called the step size. Item 8 is the 
Item of median difficulty and everyone is administered this item first. 
Think of item 8 as the first stage of a sequential procedure. At every 
stage, correctness of item response determines the next item to be admini- 
stered. Every time an item is answered correctly, the examinee Is routed 
to the next more difficult item not already encountered. Answering in- 
correctly routes him to the next less difficult Item not yet taken. The 
procedure terminates when he has answered eight items. 

Figure 3 indicates the progress of three hypothetical examinees through 
the test, along with the scores they would be assigned by one scoring 
scheme. Under this scheme, which is too intricate to go into here, the. 6 
are exactly 16 possible scores obtainable, on the basis of 8 stages. In 
other words, the same nunber of discriminations among examinees is possible 
as would be possible In a 15-ltem conventional linear test^ but only 8 Items 
are actually administered to any testee. 

Lord (1971c) performed a theoretical comparison of a 60-stage 
flexilivel test, a 60-item conventional peaked test and a linear test 
designed to discriminate at two points on the ability continuum. His 
analyses found that the flexilevel yields more information throughout the 
ability range thtn does the test designed to discriminate at two points. 
Ihe conventional p^ake^ test provided more information around the meai», but 
the flexilevel was superior beyond 1 standard deviation from the mean. In 
other words, the flexilevel test yielded more accurate measurement for the 
30% of the population in the tails of the assumed normal distribution. 

Lord's findings, of course, are theoretical and not generalizable 
beyond the rather restrictive assumptions under which they were obtained. 
Nonetheless, the flexilevel test represents a savings of approximately 50% 
of testing time—a benefit sure to inspire empirical investigations of its 
practical utility. 

One objection to Lord's flexilevel was that it is proposed as a paper- 
and-pencil test requiring a self-correcting answer sheet and an elaborate 
set of instructions. This objection is overcome by conputer administration 
of it, which requires nothing of the examinee except his item responses. 

A more cogent objection to the flexilevel scheme is its rectangular 
distribution of item difficulties, with only one item at each difficulty 
level. Since the order of arrangement of the items is all-important, minor 
errors in item scaling may cause undetectable deviations from the theoretical 
psychometric structure of the test, which would constitute a source of error 
variance. A further restriction in the flexilevel model is that all items 
have equal discriminating power— a specification that is difficult to fulfill 
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in actual test construction* 



Pyramidal Models 

An adaptive test design that comes closer to overcoming some of 
the deficiencies of the flexllevel test is th^ pyramidal test. A siiuple 
pyramidal design is shown in Figure 4* This ooe has ten stages, for 
illustrative purposes. Each stage is represented by a horizontal row of 
items » each shaded block represents an item, anv? each coluTin represents 
a difficulty level. The easiest items are at the left of figure 4 with 
each level to the right being a more difficult one. Li^e the flexilevel, 
this design features a fixed nuinber of stages, with one item administered 
per stage. But in the pyramidal model the distribution of tlem difficulty 
is not rectangular but unimodal and symmetric. 

Each examinee begins the test with an Item of median difficulty. 
At each stage the correctness of his response determines the routing. 
Three hypothetical examinees* performances are depicted in Figure 4* Note 
that a correct answer at any stage routes the testee to the next more 
difficult level at the next stage. An incorrect response sends him to the 
next easier level. Testing terminates when there are no more stages to 
progress through. . - - — — - _ 

The relative complexity of the pyramidal design makes possible an 
almost endless nund)er of variations on the theme* These can be considered 
in terms of step size, offset, number of items per stage, branching algo- 
rithms » termination rules and scoring formulae. Step size refers to the 
difficulty increment between two adjacent difficulty levels. This may be 
constant, or may vary as desired. Offset refers to the nunfcer of levels 
crossed from one sta^e to another. The simple design illustrated in 
Figure 4 used an "up~one, down-one" offset formula, but seme other formula 
might have been employed — for example "up- two, down-one," in which a 
correct answer routes the examinee two levels up, but a wrong answer routes 
him down only one level. 

Some pyramidal designs utilize two or more items per stage, with 
subsequent routing prescribed in terms of the number right at that stage. 
In such a design a manifold branching algorithm might be employed— with 
three or more oranches at each stage rather than the two shown in our 
example. Another branching algorithm might be based on which wrong answer 
was given to a multiple choice item* It should be obvious by now that 
considerable complexity is available among the multi-stage, fixed, branching 
adaptive test designs, of which the simple pyramid is the basic example* 

Another source of complexity is the multiplicity of scoring schemes 
available for pyramidal tests* Figure 5 illustrates the progress of an 
actual examinee through a 15-8 tage simple pyramidal test of verbal ability* 
Below the diagram are the scores that would be assigned the examinee using 
only a few of the scoring schemes that have been proposed* Each scheme has 
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REP0RT M PYRAMIDAL TEST 
ID NUHBERi S 5491 1 DATE TESTEOl 73/04/09 

STAGE 

18 3 4 $ 6 7 8 9 10 11 12 13 14 15 

mm 

• • • • 

• • • • 

•••••• 



mm J^f lOf^ •• 



VsX. •• • 

.X. • • " .. •• .. " .. 



• • • • 
• • • • 



I ft ^ 4 S 6 7 8 9 to fl 12 13 14 Ifi 
STAdE / 

/ 

THCRS VERE II C0RRECT ANSFl^ S« 

THESE HAD A M£AN OIFFICULTV %T •6313545 

TK£RE VERE 15 ANSWERS IN TOTAL. 

THESE HAD A MEAN DIFFICULTY 0F «75IS267 

THE FINAL ITEM HAD A DIFFICULTY 0F 1 .0052000 

THE DIFFICULTY OF THE (N<fl>ST ZTEH IS U32960 



FIGURE 3* The progress of a live examinee through a I5-stage 
ainple branching pyramidal adaptive test. 
indicates a correct response; indicates an 

incorrect respqnse. Each vow olf dot« corresponds 
* to a siigle difficulty level, with the most diffi- 
^ cult le/el at tne top of the figure. ^cores re- 
•ulting from 3 different scoring scheme? are listed 
below the figure. 
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its merits and its demerits. Which is "best" remain^' an empirical 
question whose answer may vary with the application of the ^^st. One 
pyramidal scoring technique uses the dif^'iculty rank of the^tinal item 
reached, tn this 15-stage design there are only 15 unique scores possible 
under that' schen^. A variation of this uses the final i^em scoVe (correct 
vs. incorrect) information, which doubles' the number of ranks. = Another 
similar m|:|ihod assigns scores on the basis of the difficulty level of 
the (n+1) item — the item that would be presented contingent on the 
final item response on a 15-stage test, 16 unique scores are assignable 
under this method. Other scoring schemes are based on weighted average 
item difficulties; for instance the average difficulty of all items 
attempted; that of all items correct; or a weighted average of some sort. 

Research on Fixed-branching Models 

Despite the considerable variety of approaches to adaptive testing 
based on fixed branching models, research to date has yielded consistent 
enough results that a tentative conclusion can be drawn regarding the 
utility of %H^se approaches. Some of the early work in the field used 
paper- and-pencil tests modified to permit multi-stage branching. The 
eTliest reported research was by Krathwohl and Huyser (1936), who found 
a correlation of .78 between an 8-item branched test and a 60-item parent 
test — suggesting that testing time could be markedly reduced with only 
moderate 1osl> of information. Later paper-and-pencil branched tests used 
by Bayroff and others (1960), and by Wood (1969) failed to show an advantage 
for the adaptive tests, but each of these studies had deficiencies which 
limits the generalizability of the results (Weiss an<f Betz-, 197e) . One 
of these problems was the paper-and-pencil format, which required close 
adherence to a complex set of instructions, possibly confounding the test 
sdores with ^ component unrelated to the ability b,eing measured. 

Both Bayroff and Wood subsequently used computer administration of 
similar tests, with more favorable results. Bayoff and SeeJLey (1967) reported 
corrected correlations of .83 and .79 between two 8-stage branched tests and 
much longer conventional tests drawn from the^ame pool. Another ;,finding of 
interest was a reduced intercorrelatibn between verbal and numerical tests. 
Under paper-and-pencil administration these tests intcrcorrelated .6S, com- 
puter administration reduced the correl^ation to .57, suggesting that method 
variance was reduced under computer administration. Another notable result 
was the distiibution of numerical test scores. On the branched test, the . 
distribution of scores was skewed negatively — a large proportion of subjects' 
scores fell into the high end of the distribution (N=102) . Maximimi scores 
were obtained by^ individuals whose scores on the corresponding conventional 
test spanned two standard deviations. This* may be due to a reduction of 
somec error variance component by the adaptive administration. 

Other studies of adaptive testing procedures have investigated the 
characteristics of pyramidal models and their derivatives, using empirical 
data, simulation, and theoretical analyses. ^In general their results show 
a distinct advantage for the adoptive tests in terms of test length. The 
better-designed branched tests correlate "hi^'gher with parent tests than do 
conventional tests of 'the same length. Hansen (1969) and Linn, Rock and 
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Cleary (1969) found the adaptive tests to correlate higher with external 
criteria, requiring as few as half the number of items as a conventioiial 
test to achieve the same validity. In terms of the distributions of test 
scores, multi-stage branched test scores ^typically have yielded differently 
shaped distributions than conventional tests, better approximating an 
equidiscriminating rectangular distribution (Hansen, 1969) j and itiore 
sensitive to the distributions of underlying ability (Pate^son, 1962). 

Chief among the disadvantages of multi"*stage branching tests is 
their general requirement for very large item pools relative to the length 
of the administered tests. A 10~stage simple pyramid, for example, requires 
55 items; a 15-stage pyramid, 120 items. The requirement becomes prohibitive 
as the test approaches rather moderate length. 

One solution to this problem — only a partial solution at, that — was 
put forth by Mussio (1972) using "retaining barriers" and "reflecting 
barriers," which essentially amount to truncating the pyramid beyond 
specified parameters of item difficulty. Mussio*s ideas have other merits 
mt^re relevant to measurement, but space does not permit developing these 
here . 

Variable Branching Multi-stage Strategies 

All of the adaptive strategies discussed thus far share several charac- 
teristics: a rigidly structured item pool; a fixed and unvarying branching 
rule; a termination rule based (usually) on a specified and fixed number of 
items administered. That coiil>ination makes it possible to administer tests 
by an automaton — a mechanical device — as well as by a computer. Contrasted 
with, these fixed-branching strategies are the multi-stage variable-branching 
strategies, of which I shall discuss only one—a Bayesian strategy. Variable 
branching methods, generally, are not adaptable to mechanical administration » 

They require a pooL of items of known parameters, but. not a structured pool; 
they use a variable branching rule to select the next item to be administered 
and they generally use some statistical criterion™ rather than the number of 
items administered — as a termination rule. 

Bayesian Models 

Although variable-branching strategies may be non-Bayesian , a Bayesian 
strategy proposed by Owen (1969, 1970) will serve as an example for our 
purposes. This strategy, as well as others of the genre, is called Bayesian 
by virtue of its reliance on Bayes* Theorem for estimating an examinee's 
ability. More precisely, they calculate a posterior ability estimate at each 
stnge of testing, on the basis of a prior ability estimate and the examinee's 
item response performance at^ that stage. 

Under the Owen model, as Implemented in our testing at the Unversity 
of Minnesota, n^ne variable entry points are ^ed. Associated with each 
entry point is u prior estimate of ability, and a variance of that estii^ate. 
On the basis of those two parameters, an item is selected for admlnl tration; 
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that item is the uno whicii \ iil nmiiii/e an expected posterior loss 
function. The exarinet '^i itt:' t^' p^ rsc is scored, and the posterior 
ability estimate anvl ii^ \.<'?i.ii:^t' Mlculated. The posterior estimate 

at stage 1 bGconies the prL(*i cstii^ate at static 2, and another item is 
selected and administered. This procedure continues until the variance 
of the posterior ability estimate' ^ c^nvorges to som^ arbitrary small value. 
At that point testing is torniinalcvi . An ability estimate has been obtained 
which is accurate to sov.\v provLouslv' specitied degree. 

Figure 6 depicts tlu' vionrst oi t; o hypothetical examinees through a 
Bayesian adaptive test. Ib.e .b^li^y estimates at each stage are represented 
by the dot on the i.orizont.l c\.nL ■ aui n: , The variance of each estimate is 
represented b\ the widtl; ol tl o <"oi responding distribution. Note that the 
two examinees begin at ditfereni points, therefore encounter different items, 
and require different niiirbors c^f jter^is for convergence to a final ability 
estimate* 

Figure 7 is a corpputeri-e>i report of an actual Bayesian test of verbal 
ability administered! ii. ^-esea.iih prn^-^ran. Successive stages are re- 

presented vertically. The fir^t Nl.a^e ability estimate and its standard 
deviation .re represented bv chr '.pp^rmost dotted band; subsequent stages 
follou' in order beneatlt tl.e ' ir-t. The empirically obtained data represented 
in Figure 7 provide an Cvcellent . 1 1 ic- 1 j^^tion cf the convergence process 
resulting from this Bayesi«n ability testing strateg>*. 

Using a different proceditre fc^r iten selection, Novick (1969) developed 
a Bayesian adaptive testiryr, .toJu:! ba,ser on classical test theory. His 
research findings led hir rr su.i,».t ih'H Bayesian procedures would be par- 
ticularly useful foi tvsts of ]"> to :0 items. Wood (1971) used Owen's 
Bayesian model in reseirc:f\ vbic*' .u, luded -rapirical testing as well as simu- 
lation. His ringings corr( hc^r. tef! Nr*-ick sug^:estion. Generally, the 
Bayesian procedure acc omp 1 i siie^: 85" r-.^duction of the "error of estimate within 
the first 20 items a(ir.in i k Lcrr . ^s can.pared with conventional testing proce- 
dures , the Bayesian pru t iur*- re ^M red 35:' fewer items to achieve the same 
of feet i veness 

A Maximum Likelihood "^' o^'-p^ 

Urry (1970) worked vii\ a .'-I.ay^'s 'I an -^i! 1 1 i-»st nge ^-ariable branching 
model, using monte rarlc sir !' i^r. iiis lociej involved developing maximum 
likelihood estimate?; o! ,iDi''ty, ar-i ihc variance of those estimates, 
following each test iten aJnit i .tore,!.. Urry's comparison of adaptive and 
conventional testing; re^iilfpfi ir uinber of sug^^estions for adaptive test 
design. Space limitations ,i ^ievelopln^^ these ideas here. Suffice 

it to say that under cert.nr <» [a. ions regar^ling test construction, his 
results showed that a sra;rt ndapt ive Lest can yield higher validities than 
a much longer peaked c(nivcnt f ara i lpsL. I'nder the most favorable conditions 
the reduction in test lenv^th appioa.bcd 90^;. The small body of research to 
date on multi-stage variable braixhinj^ models for adaptive testing generally 
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ability 



FK'AJUE 6: ^ Di a^^ r amma t ic ropi'esentation Df a Bayesian adaptive 
str-,itef;y. I wo examinees' performances are repre- 
senttMl. Depicted by the location and relative 
widtii ot the distributions at feach stage (1-5) is 
tlu- iedu<tion of the variance of the ability 
estiinate stt each stage. 
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confims that they promise significant reuuCticn in test length, if 
implemented, from that required by conventional tests* 

Limitations ♦ 

There are some problems inherent in the Bayesian strategies; some of 
these are common to the non-Bayesian strategies as well. The mathematics 
of the ability estimation procedure is complex enough that convergence, 
while it generally occurs within 20 items, may require considerably more 
in a few cases. Rarely, convergence may not occur under certain models. 
The same mathematical considerations require these procedures to be imple- 
mented by computer, while the simpler fixed branching techniques lend 
themselves to administration by less sophisticated devices. Another matter 
is relevant the state-of-the--art context in which this J^aper is presented. 
Most of the research results available to date were based on theoretical 
work or computer simulation studies. Tae minimal amount of empirical work 
done limits confidence in the generality of those results. The solution to 
the shortage of empirical data is obvious; several empirical studies of a 
Bayesian adaptive strategy are being conducted at Minnesota. ^ Others are 
needed. 

The Stratified Adaptive Test 

The two-state*, flexilevel, and pyramidal adaptive models mentioned 
earlier all are subject to errors of ability estimation caused by chance 
responding; In general the resulting ability estimates will be irrecoverably 
inflated or diminished in magnitude by chance correct or incorrect responses. 
The Bayesian adaptive model, since it uses a statistical criterion rather 
than the number of items as a termination rule, is not as subject to random- 
influences. To a greater degree than the other procedures, its convergence 
method permits recovery from errors of chance responding — whether it be 
guessing or a chance "miss." 

The stratified adaptive test, developed by che present puthors (Weiss, 
1973), combines the simplicity of the fixed-branching models with the 
flexibility of the variable-branching ones. The stratified adaptive test 
is essentially a multi-stage fixed branching procedure in which branching 
occurs not between a fixed structure of items but between difficulty levels, 
and the termination rule is based on a Suatistical criterion. 

Figure 8 illustrates the structure of a typical stratified test. This 
one has five levels of difficulty, or strata. Level 1 is the easiest level, 
and consists of a fixed number of items having approximately uniform difficul 
parameters. All the items at level 2 are more difficult than any item at 
level 1; and so on up through level 5. The items within each level are 
arranged in decreasing order of their discrimination indices. Ideally, each 
level of the stratified test Consists of a peaked test. The branching pro- 
cedure, in essence, seeks to route an examinee to the peaked test whose 
difficulty level is appropriate to his ability. 
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fiEP0R7 m STRATIFIED TEST 
ID NUMBER: 724176 DATE TESTED: 73/07/02 



DIFF* LEVELS 1 2 3 4 5 6 7 . 8 9 





FIGTM^E 9. Tho relatively consistent per\f ornlance of a live 
examinee on a stratii'ied adaptive test of word 
knowledge. indicates a correct response; 

* ' indicates an incorrect response. Stage 

number precedes the item response. The ability 
level appropriate to this examinee (Level 6) was 
iden t if ied in l4 stages . 
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REP0RT 0N STRATIFIED TEST 
ID NWBERt 882897 DATE TESTEDt 73/07/02 




l'\<t^Uh lO,, An crnpi r 1 f -i 1 1 \ obsf^rvfd itiq ons j t fn t performance 
on .i srr.jtififMl ad.iptive tf-st of word knou edge* 
J I st,if\i'S wt'i o re{ju 1 r»Mj to identify t Vie ability 
]pvel fippnopriatc to this •'xaminee.^ (S»?p Fi^^ure 9 
lor riH Lin s ot t h*.* s > nibo 1 s used.) 
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As presently conceived, the stratified test uses variable entry levels. 
Prior knowledge about the examinee—or perhaps his self-report—determines 
the difficulty level of the first item presented. From that point any one 
of a number of branching rules takes over. For example, a correct response 
may route the testee to a more difficult level; an incorrect response to an 
easier level. At each level, the examinee is administered the most dis- 
criminating item not yet attempted at that level. Under the present strategy, 
testing terminates when an examinee is responding with only chance success 
at any level, and he is assigned a score commensurate with the highest level 
at which he was responding correctly at a rate greater than chance* 

Figures 9 and 10 illustrate the progress of two individuals through a 
9-level i>tratified verbal t€fst. The branching strategy is easy to see here, 
and the d^fference in test length illustrates one important characteristic 
of the approach. The first examinee was quite consistent in his performance, 
and was classified as to level within 14 items. The second examinee, less 
consistent, took 4J items before being classified. This latter performance, 
althougji atypical, points up the flexibility of the method. 

So far I have covered the five basic categories of adaptive testing 
strategies, and mentioned some of the research findings pertinent to them. 
To do this in the limited space available, much detail was necessarily omitted, 
A quite thorough review of the literature cfn adaptive testing has been pre- 
pared as a technical report by Weiss and Betz (1973). That document fills 
in a considerable proporcion of the detail missing here, and contains numerous 
references in addition to those I have cited. 

Minnesota Computerized Ability Testing Research 

Mentioned earlier was the paucity of empirical research results^ in the 
literature of computerized adaptive testing. One empirical research effort, 
sponsored by the Office of Naval Research, is in progress at the University 
of Minnesota. The purpose of the research is to investigate the relative 
utility of adaptive testing vert us conventional testing, and to determine 
the relative merits of various operationalizations of adaptive testing, in- 
cluding the five adaptive strategies discussed. 

The work is being conducted using verbal and numerical ability test 
items administered at CRT (cathode ray tube) terminals to a Control Data 
Corporation 6400 time-shared computer system. The two different ability 
dimensions were selected in order to investigate validity generalizability 
across content areas (a secondary objective of the research project), ^s 
well as any differences in psychometric characteristics between multiple- 
choice (the verbal items) and free-response (the numerical items) formats. 

On the basis of preliminary norming studies, traditional item parameters 
as well as normal ogive model item characteristic curve parameters have been 
obtained for 605 vocabulary items and 200 number series items. Currently, 
both linear and adpative tests have been constructed from the vocabulary 
item pool, while the numerical pool is still being normed and expanded. 
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The basic design of the adaptive strategy comparisons is illustrated 
in Figure 11* Each subdiagonal cell represents an intertest correlation; 
the diagonal entries represent test-retest correlations.* At present only 
one of these correlations is available for reporting, although data have been 
collected for each comparison whose cell in the figure contains a darkened 
circle. In two cases, separate data have been obtained for 2 distinct 
examinee groups: college students and high school students. It is hoped 
that we shall be able to replicate all these comparisons in at least two 
populations differing as to average level of ability. 

The diagonal elements of Figure 11 are tesfretest stability studies, 
since temporal stability is an important practical criterion for the evalua- 
tion of alternative testing strategies. To date, short-term ^approximately^ 
5-week) test-retest stability data are available for each of the testing 
strategies shown in Figure 11. 

Another aspect of the same research involves computer simulation of 
adaptive testing. Using monte carlo techniques to vary item parameters 
(difficulty, discrimination) and people parameters (shape ot the ability 
distribution and its range) we hope to find answers to a number of questions 
relevant to adaptive testing, which at present remain unanswered. Among 
these are questions regarding the effects on adaptive test characteristics 
of varying the characteristics of the iten pool — numbers of items, range 
and distribution of item parameters, etc. Another problem to which simulation 
studies should provide a tentative answer is that of the effects of guessing 
on the utility of adaptive testing. Derogation of test effectiveness by 
random guessing may require that more sophisticated testing models be employed. 
On the other hand, negligible effects due to guessing might effect reduction 
of the cost of adaptive testing by permitting the use of lalatively simple 
models. , 

The scoring problem also lends itself to investigation by coo^uter 
simulation. The variety of scoring schemes available for each of the 
adaptive procedures is at present a source of some puzzlements Simulation 
research should clarify the matter of what scoring techniques are advantageous 
for each adaptive strategy under specifiable conditions. 



I have mentioned only a few of the questions to which simulation studies 
should provide answers; other such questions undoubtedly will arise in the 
reader's mind. It is important to remember that the generality of those 
answers is limited by the assumptions under which the sixdulations are con- 
ducted. Our inteia*.on is to generate tentative answers to a number of per- 
tinent questions, then to subject those results to empirical verification. 

In keeping with that intention, we have proposed a continuation of the 
present research, again under ONR sponsorship. In the i^.iort run, that pro- 
posal includes 1) continued data collection in the college population, in 
order to complete the inter-strategy comparisons outlined in Figure 11: 
2) replication of the present research design in an examinee population 
differing in central tendency and variability from the college group (this 
has already been begun, ufing high school students); and 3) development of 
improved variations on the basic adaptive strategies discussed in this paper. 
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In the longer run, we have proposed a large scale validity study, 
testing several thousand Navy recruits. This research would involve ^norming 
the two item pools on samples drawn from the recruit population, followed by 
real data simulations, using the norming study data to select the most pro- 
mising adaptive strategies. Tl\e best strategies would be employed in live 
Qomputer-administered testing of recruits, whose graded performance in train- 
ing and operational settings subsequent to recruit training would serve as 
the validity criterion. , 



The stated aim of the .symposium included assessment of the state of the 
art of Occupational Research, with an eye toward the planning of future pro- 
grams. This paper has proposed computerized adaptive testing as a potential 
involvement in the measurement of occupationally-related abilities, one which 
shows promise of more accurate, and potentially more valid, measurement in less 
tine than present group-standardized tests. Substantial gains in the amount 
of occupationally-relevant information obtainable per unit of time certainly 
would appear beneficial to *decision-makerc within the organizations concerned. 
Gains in the accuracy of ability measuremenc, especially if achieved by 
reducing the effects of irrelevant variables on test performance, would appear 
beneficial to the interests of the individuals concerned. Reports of past 
research in the area of adaptive testing suggest that both kinds of gains can 
be expected, given well-constructed tet Very f<^v such tests exist today. 
What is called for is a continuing program of theoretical consideration of 
the potential of computerized adaptive testing, in conjunction with compre- 
hensive empirical investigation of practical problems and practical utility. 
Such a program, with particu? r ^^mphasis on empirical aspects, I would suggest 
to the members of this syinpo<= * as an important direction for research and 
development through the rema-.iaer of this decade. 
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PROBLEMS AND "PROSPECTS IN/tKE 
ASSESSMENT OF NONCOGNITIVE /TRAITS 
P. M. Rentier 



An oVeiat^iehning emphasis has been placed on the meisurement of cognitive 
or intellective^^frait^^n the educational arena, in Industry, and in the armed 
services. The use of Tntcrll^ct^ive measures for asiiessment , prediction, 
selection, and classification putpo^^ is coming uader ever-increasing attack 
for a nunfcer pf reasons. Most obvious ly>4,t^as become clear et tKe empiri- 
cal level that intellective traits — even gener^i-4iitell:».gence — account for 
only relatively small proportions of variance in the A?aii^ty of tasks that 
confront people in their everyday lives. At the theoretical^^:smd_empiri jal 
levels, in spite of Guilford's (1967) exhatistive an'^ comprehensive^ 
dimensional system for classifying intellective attributes, our understand!? 
and differential measurement of the variety of cognitive attributes has not 
proceeded very far. Lacic of empirical validitv and theoretical understanding, 
combined with the behaviotisric movement in psychology which emphasizes, 
the highly specific nature of most behaviors, calls into question even the 
ultimate possibili.y of predicting a variety of behaviors from only a few 
cognitive constructs. Finally', the Civil Rights Act of 196A and the later 
Equal Employment Opportunity Act of 1972 require modification of t:,rpical 
testing practices to become more specii:ic In matching the person to the job, 
rather than measuring the person in the abt:tract (Fincher, 1973). The 
removal of bias to make tests applicable to minority populations has become 
a major goal, often accompanied by an anti-intelligence te55ting movement well 
known to most of you. 

The most consistent emphasis on measurement of intellectual competence 
has probably come from the educational institution. There are signs that 
even this institution is shifting its orientation to some extent. For example, 
the conservative College Entrance Examination Board (1970) has suggested that 
a wider sampling of talents be assessed for college entrance and reported to 
colleges for revised base$ of decision making. There is a consensus that 
such talents should include real-life relevant variables, such as attitudes, 
interests, personality and values, and McCielland (1973) has suggested that 
the following competencies, at the very least, ought to be included in the 
assessi?cnt batteries of testing services: communication skills, patience, 
moderate goal setting, and ego development. The recent Jencks et al. (1972) 
report a] so suggested that non-cognitive attributes may play a larger role 
than cognitive skills in determining economic success or failure, and suggests 
that these traits may contribute far more than cognitive skills to the quality 
of human life and human happinoss. Similar movements are being felt in 
industry and the armed forces, but, as ever, crucial problems remain. 

I would like to outline what I consider to be some major, current 
problems facing researchers and test specialists in this area, and indicate 
what direction we might move, in order to generate more useful n^asures. 
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1. An overview of the literature on non-cognitive trait measurement / 
reveals a distirxt .absence of agreement regarding either the empirical 
structure of . the donain of non-intellective trait measurement, or ev^n a / 
theoretical consensus regarding the fundamental attributes that require / 
measurement. A perusal of the Seventh Mental Measurements Yearbook (Bu^bs, 
1972) indicates how most of the well-known traditional tests in the pepfeon- 
ality, values, attitudes, and interests domain fall far short in the measure- 
ment as well as theoretical sense. Typically, these instruments measure 

only a few dimensions, or they measure ipsativelyV or th^y require an 
advanced reading comprehension, or the structure of the ' instrument is quite 
unclear. In the personality. domain, for example, the Minnesota Multli^asic 
Personality Inventory, the Edwards Personal Preference Schedule, the 
Guilford Zimmerman Temperment Survey, the Catell 16-PF, the Eilwards Person- 
ality Inventory, and others have come under severe attack by* a nuober of 
workers. For example, the highly elaborate conceptual framework underlying 
Catell' 8 test has recently been shown to be inadequate in two mcmuaental 
studies (Sells, Demaree, and Will, 1970; 1971). Althou^ more recent 
instruments, such as Jackson's Personality Research Form and Comrey*s 
Personality Scales are at least reliably and multidimensional, it still 
reinains true that the constructs assessed by these and other newer measure- 
^4Qent Instruments are far from universally accepted. There does not exist 
a coftsan^us regarding the nature of important personality variables. I 
would hopethat^^the next decade can clarify the nature of underlying attributes 
but I am only cautBlmsly^ptlmistlc about this^ prospect . If there is to be 
consensus, I expect it to ^row^^out o^ the peer methods of measuring person- 
ality, as stemming from the wotk^of-^Jtlske , Tupes and Christal, Borgatta, 
and Warren Norman (1969) . As a result oF^^the^ work by these persons there 
seems to be a consensus at the very least regardlitg-.the attributes extra- 
versior., agreeableness, dependability, and emotional stabUl^y. 'Unfortunately 
these broad dispositions have not yet been adequately dissected^lnto^^omponents 

2. The measureraLnt of lulnor >jariables redundant with previously 
measured variables, rather than a concentration on major behavioral attributes, 
continues to be an unfortunate focus of current work. The field is replete 
with hundreds of measures having little or no iiq>llcation for important 
criterion behaviors. Yet, it is becoming clear from work in other areas 

that significant non-intellective traits do exist and have important predictive 
validity. For example, Robins (1972) found that school dropout, heroin use, 
divorce, jail, and alcohol problems were intercorrelated events in a san^le 
of 223 young urban-bom and urban-reared black men. Similarly, Roff and Sells 
(1968) show in a saiq>le of thousands of youn^ters, that boys who are rejected 
by their peers tend to become delinquent on followup. It is unlikely that 
these events are solely the result of the operation of intellective variables, 
as some literature mi^t have one believe. Intellective and noncognitive 
variables can be remarkably interrelated. An liipcrtant study by Roff, Sells 
and Golden (1972) demonstrated a consistent difference of about 15 to 20 IQ 
points between children liked most and children liked least by their peers, 
in a sample of 2,800 children. While it is. Indeed, possible that smarter 
children become liked more, social learning theor>' would also predict that 
children who are liked more become smarter — through the mechanism of greater 
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positive reinforcement i'or learning in a school environment. To focus on 

the intellectual variables alone would surely be a mistake* 1 would hope 

that the next decade can be fruitfully used to delineate important behavioral 

variables in the noncognitive areas of interest to this conference. 

3. Lack of multitrait irultimethod validity for existing instruments 
probably remains the major stumbling block in non-cognitive trait measurement* 
Mischel (1968) reviewed the ^s ad predictive validity of personality measures, 
and Abelson (1973) similarly summarized the poor predictive performance qf 
attitude measures in predicting significant behaviorafl events, the more 
general criticism can be made of all measures in the non-Intellective trait 
area, whether they be ^^lues, interests , personality, or attitudes, that 

the measures possess little, in the way of convergent validity, but perhaps 
equally important, they possess little discriminant vaLi-dity*— Of ten little 
irore than the three dimensions of semantic space are being measured by per- 
sonality scales. Not even the recently discovered seven semantic diinensions- . 
are assessed (Bentler & Lavoie, 1972a). Although Campbell and Fiske (1959) 
made clear that any set of*multiple measures required ot least a partial 
demonstration of convergent and discriminant validity, it is surprising that 
a decade-ahd-a-half after publication of this classic article not a single 
multivariate test exists that has even published one multitrait multimethod 
matrix. 1 do know about one case in which such a matrix existed, but the 
author did not publish the entire matrix. Instead he simply listed the 
part of the matrix — the convergent validities — that was flattering to his 
test. I would hope that the next decade yields at least a' few instances of 
Campbell-Fiske validation. Ideally, of course, such attempts would demonstrat 
the successful measurement of important constructs; but I would even be encour 
aged ty the publication of unsuccessful validational attempts in this area. I 
suspect that very little progress will be made toward developing measures of 
important non-cognitive traits until method-free instruments or techniques 
of validation are developed. I think a reliance on self-report statements 
alone, as is all too t)rpically done, is a foolhardy procedure. I have been 
devoting a substantial portion of my time to developing 28 trait measures 
possessing peer-self validities, with a surprising amount of success. 

4. Perhaps the largest class of non-cognitive trait measures are 
seTf^=Tepcrt in nature — and self-report is fakeable. The fourth major problem 
I see lies^^l^-the lack of availability of maximum performance measures. 
These would be relativejj^ unfakeable. As Wallace (1966), McClelland (1973) 
and others have enq)hasize<J7^*^-4s important to devise measures in which the 
subject is made aware cf the attrl&Ttte^being measured, and is asked to 
maximize his performance. Such procedures^^a^e^tandardly used in simulation 
tests as well as in intelligence tests. ImplemenlTin^aniaximum performance 
measurement will require the development of behavioral te^ts^jjemonstratlng 
the requisite validities. I would hope in the next decade we statt^t:^_work 
on these tasks. I suspect that the major impetus for this work will come 
from the necessity of devising job-sampled instruments which typically serve 
as criteria rather than predictor variables. 
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5. It is well nam that inadequate loeasures exist for minority group 
members. This fifth problem requires, at the very least, obtaining norms, 
reliabilities, and validities that have relevance to special, but important 
and previously unmeasured, target pupulations. For example, women are surely 
going to enter nontraditional occupations. Not only is the surmounting of 
this problem an ethical requirement for those who work in the field, but it has 
become a legal requirement as well. The courts will no longer accept irrele- 
vant measures. In the long run, this means that tests will have to be devised 
with these special populations in mind. Perhaps new testing formats will 
have to be devised, such as my own non-verbal semantic differential (Ben tier 
& .LaVoie, 1972b). It will provide a challenging task to devise assessment 
procedures that do not yield a double standard or bias when applied in practice. 
Yet, devising such measures is a legally required taak for the future. 

^ 6. It is quite appropriate that an institution aim to maximize its 

objectives, and in the past there has been a major emphasis on the utility 
of testing for Institutional purposes (Wiggins » 1973). I think this emphasis 
represents the sixth problem, since as the culture changes to va}.ue diversity 
and individual growth, we will have to adopt a strategy that not only maximizes 
institutional utility, but maximizes the utility of testing for an individual 
as well. Tests must generate consequences helpful to an individual's longr 
rapge goals as well as decisions assisting the functioning of an ongoing 
Institution. The law has at least reco^gnized that testing cannot unfairly 
harm an individual, by being biased against him without legitimate grounds, 
but I suspect that the law will . not provide the necessary emphasis towards 
the growth of the individual. However, J do believe that as large institutions 
recognize their ^ role in fostering individual creativlcy, growth and adaptation, 
the trend toward assistance in such growth will continue. 

7. It is not h^rd to explain how large institutions in times of an 
expanding population have relied heavily on tests to assist their selection 
of candidates. Selection of volunteers for the armed services r^.^resents 
one such example. While selection will continue to be an importart focus 
of testing practices, the nature of selection will have to change, and 
classification will become more relevant. This is the seventh problem area. 
As mentioned several times, selection procedures will have to be based upon 
demonstrated validity, or else the law will refuse to recognize their accept- 
ability. This legal requirement will put great strain on the development of 
effective criterion measures, since most predictors are not much better than 
th^ criteria they can hope to be related to. But the selection process will, 
in estimation, give way to a greater eiq>ha8is on classifying existing 
Individuals into multiple positions of optimal benefit both to the individual 
and institution. If there are deficiencies in an individual's qualification 
for a particular job, I suspect that training programs will aim. to modify 
these. Training will replace -election. The selection ratio will also no 
doubt change, and as the pressures converge on institutions to accept most 
anyone, classification procedures that match people and appropriate Job 
categories—being of benefit both to the institution and the individual-— 
will become of greater value. 
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8. A problem closely related to 



implementing useful cla&siflcation 



r.rocedures lies in the development of a reliable and replicable methodology 
for classifying psople (Rulon, Tiedeman, Tatsuska, Langmulr, 1^67). Trait 
psychology has generated such avid adherents that the typologists have 
been relegated to the wayside. Only recently are tools for generating 
typologies involving clustering procedures being seriously investigated, 
and the hypothesis of multivariate normal distributions of traits is' slowly 
being subjected to more careful scrutiny.- The success of training programs, 
experimental manipulations, and the like surely hinge on the nature of the 
people being included. I suspect that the problem of developing typologies 
of people will be taken more seriously in the next decade, particularly as 
better measures of socially significant variables become available. 

9. Implicit in most of ray previously identified problems lies a series 
of methodological, psychometric, aid statistical problems thf»t require 
solution. Thus, the ninth problem area involves the lack of adequate analytic 
techniques to be used i!n generating meaningful analyses for the content problems 
of interest to us. In spite of the progress made in the development of 
multivariate r*etbods over the past decade, numerous problems remain. For 
example, cluslerxng techniques that for the first time are being seriously 
investigated, still require too many subjective decisions in their use. 
Although factor analytic methods have become more sophisticated recently 

in the development of scale-free methodologies, restricted factor solutions, 
and target rotation procedures, nonetheless they cannot yet cope with the 
old problem of Heywood cases, Gramain residual matrices, the measurement of 
mean change, and analysis of very large matrices such as 600 variable, 30 
factor problems. The linear model is unduly restrictive, particularly in 
the typical binary data case. More general models, such as those involving 
monotonic relationships rather than linaar relatior?j, deserve further study 
and deveI^s^ment. Some of my own work haa recently been directed to these 
preas (BeritHr, 1970, 1972a, 1972b, 1973). Multivariate analysis of variance 
methodologiesXalso require implementation and distribution* And of course^ 
there are numerous important developments that have potential bearing on 
this area, sucnv as the work on path analysis, generalliability theory, 
functional measurement, etcet era. 1 suspect these technical .difficulties can 
be solved more easily than the conceptual problems more particular to per- 
sonality assessment as a science. 

10. Finally, the tenth problem that I see lies in the confront jit ion 
between the increasing demands made upon institutions for generating optimal 
decisions in this area, while these institutions are at the same time faced 
with declining research funds to enable them to generate solutions and study 
various alternative procedures for solving these problems. For this contra-* 
diction, I have no long-range prediction. I can only hope that things get 
batter again^ 

A I night say a few concluding words highly specific to a project in ^ 
non-cognitive trait measurement that I understand is being conducted for 
the Navy. I am not entirely optimistic about the eventual success of 
that enterprise. The problems involved are too many; and I am not convinced 
that adequate precautions have been taken to meet some of the general 
criticisms of work in this area such as I have presented above. As I under- 
stand it, the test items are very traditional single-stimulus true-false 
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likely txx-yi^ld strong method factorc; the wording is lengthy 
; ffi/x poor readers, so that auditory presentation formats 



response type, 
and not appropriate 

become necessary; tie techniques of scale construction represent inappro- 
priate linear f&:toA models using blind rotation procedures; analyses are 
based on partial data; and a one-shot scale* construction strategy is empha- 
sized. Althb igh experts in the field have framed the overall approach, I 
cannot be optimistic about the product of such procedures, given the results 
that other workers have achieved using similar approaches. 
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